Oct 30 23:05:53.294934 ip-10-0-133-110 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 23:05:53.682629 ip-10-0-133-110 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:05:53.682629 ip-10-0-133-110 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 23:05:53.682629 ip-10-0-133-110 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:05:53.682629 ip-10-0-133-110 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:05:53.686215 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686124    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.686215 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686211    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.686215 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686216    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.686215 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686219    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.686215 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686222    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686225    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686230    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686235    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686238    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686241    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686244    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686247    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686250    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686252    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686255    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686258    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686260    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686263    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686266    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686269    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686271    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686274    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686277    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.686407 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686280    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686283    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686285    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686289    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686291    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686294    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686297    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686300    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686302    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686305    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686307    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686310    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686312    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686315    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686317    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686320    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686323    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686326    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686330    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.686866 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686334    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686338    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686341    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686344    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686346    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686349    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686372    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686376    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686380    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686383    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686387    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686390    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686392    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686396    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686398    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686402    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686404    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686407    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686410    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686412    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.687309 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686415    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686418    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686420    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686423    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686426    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686428    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686431    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686434    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686438    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686441    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686443    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686446    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686449    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686451    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686454    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686457    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686459    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686462    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686464    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686467    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.687797 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686470    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686473    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686476    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686478    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686481    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686484    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686487    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686489    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686492    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686494    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686497    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686500    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686502    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686505    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686508    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686511    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686513    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686516    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686519    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.688291 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686521    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686524    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686527    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686530    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.686532    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687338    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687346    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687349    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687352    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687354    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687357    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687360    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687362    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687365    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687368    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687371    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687374    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687377    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687380    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687383    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.688754 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687386    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687388    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687391    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687394    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687396    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687399    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687402    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687404    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687407    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687409    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687412    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687415    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687417    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687420    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687423    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687426    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687429    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687431    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687434    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687437    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.689273 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687439    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687442    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687445    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687447    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687450    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687452    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687455    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687457    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687461    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687464    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687467    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687470    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687473    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687477    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687481    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687484    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687488    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687490    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687493    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.689763 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687496    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687499    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687501    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687504    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687506    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687509    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687512    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687514    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687517    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687519    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687522    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687525    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687527    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687529    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687532    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687535    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687538    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687540    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687542    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.690243 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687545    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687547    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687550    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687554    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687558    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687560    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687563    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687566    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687569    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687571    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687574    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687577    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687580    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687582    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687585    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687587    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687590    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687593    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687596    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.690714 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687598    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687601    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687603    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687606    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687608    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687611    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687630    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687635    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687638    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687641    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687644    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687647    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687650    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.687653    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688135    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688140    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688144    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688147    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688150    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.691154 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688153    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688156    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688158    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688161    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688164    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688166    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688169    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688172    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688175    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688177    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688180    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688183    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688185    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688188    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688191    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688193    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688196    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688199    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688201    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688204    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.691599 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688206    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688209    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688211    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688214    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688217    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688220    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688222    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688225    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688228    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688231    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688234    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688237    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688239    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688243    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688248    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688252    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688255    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688258    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688261    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.692072 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688264    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688266    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688269    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688272    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688274    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688277    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688279    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688282    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688284    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688287    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688289    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688292    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688295    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688298    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688300    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688303    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688306    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688308    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688311    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688314    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.692516 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688316    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688320    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688323    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688325    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688328    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688331    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688334    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688336    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688339    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688341    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688344    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688346    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688348    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688351    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688353    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688356    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688358    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688361    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688363    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.692996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688366    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688368    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688371    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688373    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688376    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688378    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688381    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688383    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688386    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688388    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688391    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688394    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688397    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688399    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688405    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688407    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688410    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688412    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688416    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688418    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.693428 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688422    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688424    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.688427    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689418    2576 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689432    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689438    2576 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689443    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689448    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689451    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689455    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689459    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689463    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689465    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689469    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689473    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689477    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689480    2576 flags.go:64] FLAG: --cgroup-root=""
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689483    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689486    2576 flags.go:64] FLAG: --client-ca-file=""
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689489    2576 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689492    2576 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689504    2576 flags.go:64] FLAG: --cluster-domain=""
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689510    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 23:05:53.693895 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689514    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689517    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689520    2576 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689531    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689534    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689537    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689540    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689543    2576 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689547    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689550    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689554    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689557    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689561    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689564    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689567    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689570    2576 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689573    2576 flags.go:64] FLAG: --enable-server="true"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689576    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689580    2576 flags.go:64] FLAG: --event-burst="100"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689583    2576 flags.go:64] FLAG: --event-qps="50"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689586    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689589    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689592    2576 flags.go:64] FLAG: --eviction-hard=""
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689597    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 23:05:53.694432 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689600    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689603    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689606    2576 flags.go:64] FLAG: --eviction-soft=""
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689609    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689627    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689632    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689637    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689642    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689645    2576 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689648    2576 flags.go:64] FLAG: --feature-gates=""
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689652    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689656    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689659    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689662    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689665    2576 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689668    2576 flags.go:64] FLAG: --help="false"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689671    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689675    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689678    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689681    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689685    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689689    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689692    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 23:05:53.695063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689695    2576 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689698    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689700    2576 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689703    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689707    2576 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689710    2576 flags.go:64] FLAG: --kube-reserved=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689713    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689716    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689719    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689722    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689725    2576 flags.go:64] FLAG: --lock-file=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689728    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689731    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689734    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689740    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689743    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689747    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689751    2576 flags.go:64] FLAG: --logging-format="text"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689753    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689757    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689760    2576 flags.go:64] FLAG: --manifest-url=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689763    2576 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689767    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689770    2576 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689774    2576 flags.go:64] FLAG: --max-pods="110"
Oct 30 23:05:53.695673 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689778    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689781    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689784    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689787    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689790    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689793    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689796    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689805    2576 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689808    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689811    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689814    2576 flags.go:64] FLAG: --pod-cidr=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689817    2576 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689820    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689823    2576 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689826    2576 flags.go:64] FLAG: --port="10250"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689829    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689832    2576 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-01271fa1ed2a041e3"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689835    2576 flags.go:64] FLAG: --qos-reserved=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689838    2576 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689841    2576 flags.go:64] FLAG: --register-node="true"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689844    2576 flags.go:64] FLAG: --register-with-taints=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689848    2576 flags.go:64] FLAG: --registry-burst="10"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689851    2576 flags.go:64] FLAG: --registry-qps="5"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689855    2576 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689858    2576 flags.go:64] FLAG: --reserved-memory=""
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689861    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 23:05:53.696253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689865    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689868    2576 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689870    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689873    2576 flags.go:64] FLAG: --runonce="false"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689876    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689879    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689882    2576 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689885    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689888    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689892    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689895    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689898    2576 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689901    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689904    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689907    2576 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689910    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689913    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689916    2576 flags.go:64] FLAG: --system-cgroups=""
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689920    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689925    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689928    2576 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689931    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689935    2576 flags.go:64] FLAG: --tls-min-version=""
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689938    2576 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689941    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 23:05:53.696886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689944    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689947    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689950    2576 flags.go:64] FLAG: --v="2"
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689954    2576 flags.go:64] FLAG: --version="false"
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689963    2576 flags.go:64] FLAG: --vmodule=""
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689967    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.689970    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690104    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690107    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690110    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690113    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690115    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690118    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690120    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690123    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690125    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690128    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690131    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690134    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690136    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690138    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.697472 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690141    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690143    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690146    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690148    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690155    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690157    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690160    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690163    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690165    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690167    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690170    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690172    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690175    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690178    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690180    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690183    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690186    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690188    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690191    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690194    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.697982 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690196    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690199    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690201    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690204    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690207    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690209    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690212    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690214    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690217    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690220    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690223    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690225    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690227    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690230    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690232    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690235    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690239    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690241    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690244    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690247    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.698456 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690249    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690252    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690255    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690258    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690260    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690263    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690265    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690268    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690271    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690273    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690276    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690278    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690281    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690283    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690286    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690288    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690291    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690293    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690297    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690301    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.698969 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690304    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690306    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690309    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690312    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690314    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690317    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690319    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690322    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690326    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690329    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690333    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690336    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690338    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690340    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690343    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690346    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690349    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690351    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690354    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.699434 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690356    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690359    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690362    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690364    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690368    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690373    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690376    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690379    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690382    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690385    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690387    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690390    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690392    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.690418    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690455    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.699882 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690459    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690463    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690465    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690468    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690470    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690473    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690477    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690479    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690482    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690486    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690488    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690491    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690493    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690496    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690499    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690502    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690504    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690507    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690509    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.700236 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690512    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690514    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690517    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690520    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690522    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690525    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690527    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690530    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690532    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690535    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690538    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690540    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690543    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690546    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690548    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690552    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690554    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690557    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690559    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690563    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.700695 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690566    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690568    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690573    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690575    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690578    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690580    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690583    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690586    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690588    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690591    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690593    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690596    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690598    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690601    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690604    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690607    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690609    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690626    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690631    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.701157 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690635    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690638    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690641    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690644    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690646    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690649    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690651    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690654    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690656    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690660    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690663    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690666    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690670    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690673    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690675    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690679    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690682    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690684    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690688    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690692    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.701597 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690694    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690697    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690699    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690702    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690704    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690707    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690710    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690712    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690715    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690718    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690721    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690724    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690727    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690729    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690732    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690735    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690737    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690740    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690743    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.702233 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690745    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690748    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690750    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690753    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690758    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690763    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690766    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.690769    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.698171    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.698186    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.698722    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.698730    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698785    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698791    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698795    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698798    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698800    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698803    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698807    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.702693 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698810    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698813    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698817    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698821    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698824    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698827    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698830    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698832    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698835    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698837    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698840    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698843    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698845    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698848    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698850    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698853    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698855    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698858    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698860    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.703142 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698863    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698866    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698869    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698873    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698876    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698878    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698881    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698884    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698886    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698889    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698892    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698894    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698897    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698901    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698906    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698909    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698911    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698914    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698917    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.703574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698919    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698922    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698925    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698927    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698931    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698933    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698936    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698939    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698941    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698944    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698947    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698949    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698952    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698955    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698958    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698960    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698963    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698967    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698970    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.704032 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698973    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698976    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698978    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698981    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698984    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698986    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698989    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698992    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698994    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.698997    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699000    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699002    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699005    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699008    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699010    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699013    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699015    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699018    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699021    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699023    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.704515 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699025    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699028    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699031    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699033    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699036    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699038    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699041    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699045    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699047    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699050    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699053    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699056    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699059    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699061    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699064    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699066    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699069    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699071    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699074    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699077    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.705003 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699079    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699082    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.699110    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699245    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699250    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699253    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699255    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699258    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699261    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699264    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699266    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699269    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699272    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699274    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699277    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699280    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.705489 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699282    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699285    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699287    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699290    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699293    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699296    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699299    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699301    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699305    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699307    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699310    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699312    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699315    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699317    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699320    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699322    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699325    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699328    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699330    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699332    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.705918 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699335    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699337    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699340    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699342    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699345    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699347    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699350    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699352    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699355    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699357    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699360    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699362    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699365    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699369    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699373    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699376    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699379    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699382    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699384    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.706403 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699387    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699389    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699392    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699395    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699398    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699400    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699403    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699407    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699410    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699413    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699416    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699418    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699421    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699423    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699426    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699428    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699430    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699433    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699436    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.707134 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699439    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699441    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699444    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699447    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699449    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699452    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699454    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699457    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699459    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699462    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699465    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699467    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699470    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699472    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699475    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699477    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699480    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699483    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699485    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699488    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.707665 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699491    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699493    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699496    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699499    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699501    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699504    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699506    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699509    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699512    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699514    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699517    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699520    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699522    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699525    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699527    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.699550    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:05:53.708177 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699585    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699590    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699593    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699597    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699599    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699603    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699606    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699609    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699611    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699627    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699630    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699633    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699636    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699639    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699642    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699645    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699648    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699651    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:05:53.708552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699654    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699657    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699660    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699662    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699664    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699667    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699669    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699672    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699675    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699678    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699680    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699683    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699685    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699688    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699690    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699693    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699695    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699698    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699700    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:05:53.708996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699703    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699706    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699708    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699711    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699713    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699716    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699718    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699720    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699723    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699726    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699729    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699731    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699735    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699737    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699740    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699742    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699745    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699747    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699750    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699752    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:05:53.709518 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699755    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699757    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699760    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699762    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699765    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699767    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699770    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699772    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699775    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699777    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699779    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699782    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699785    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699787    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699790    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699792    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699795    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699797    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699799    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699802    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:05:53.710043 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699804    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699807    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699810    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699812    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699815    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699820    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699823    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699825    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699828    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699832    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699834    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699837    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699839    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699842    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699844    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699847    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699849    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699852    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699855    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699857    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:05:53.710501 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699860    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699862    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699865    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699867    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699870    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699872    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699876    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699878    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:53.699881    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.699933    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.701816    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.702703    2576 server.go:1014] "Starting client certificate rotation"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.702803    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.704109    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.705140    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:05:53.710987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.710240    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:05:53.719795 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.719776    2576 log.go:25] "Validated CRI v1 runtime API"
Oct 30 23:05:53.723427 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.723411    2576 log.go:25] "Validated CRI v1 image API"
Oct 30 23:05:53.724194 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.724171    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 23:05:53.726483 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.726455    2576 fs.go:135] Filesystem UUIDs: map[52908d6c-5829-41ce-a412-e277f54a3ea0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7a39cd70-4f54-4cb9-8e78-087db231a77c:/dev/nvme0n1p3]
Oct 30 23:05:53.726554 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.726482    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 23:05:53.731662 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.731530    2576 manager.go:217] Machine: {Timestamp:2026-10-30 23:05:53.730297021 +0000 UTC m=+0.314760938 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101446 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d46295847694264aaec43fc42759a SystemUUID:ec2d4629-5847-6942-64aa-ec43fc42759a BootID:9885737a-6d77-456d-a58b-d994f46d49af Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:3e:40:34:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:3e:40:34:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:78:9a:b5:b8:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 23:05:53.731662 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.731660    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 23:05:53.731765 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.731742    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 23:05:53.733887 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.733862    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 23:05:53.734023 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.733890    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-110.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 23:05:53.734064 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.734026    2576 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 23:05:53.734064 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.734033    2576 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 23:05:53.734117 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.734065    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:05:53.734117 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.734082    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:05:53.734800 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.734790    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 23:05:53.738395 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.738381    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 23:05:53.738517 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.738507    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 23:05:53.739197 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739187    2576 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 23:05:53.739227 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739202    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 23:05:53.739227 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739213    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 23:05:53.739227 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739222    2576 kubelet.go:405] "Adding apiserver pod source"
Oct 30 23:05:53.739333 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739229    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 23:05:53.739596 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.739581    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:05:53.741603 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.741586    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 23:05:53.748599 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.748582    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:05:53.749348 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749334    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 23:05:53.749410 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749364    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 23:05:53.749521 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749511    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 23:05:53.749552 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749527    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 23:05:53.749552 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749533    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 23:05:53.749552 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749538    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 23:05:53.749552 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749544    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 23:05:53.749552 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.749551    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 23:05:53.750391 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750383    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 23:05:53.750430 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750392    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 23:05:53.750430 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750400    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 23:05:53.750430 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750406    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 23:05:53.750430 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750415    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 23:05:53.750430 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.750424    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 23:05:53.751644 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.751626    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 23:05:53.751644 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.751636    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 23:05:53.755475 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.755459    2576 server.go:1263] "Started kubelet"
Oct 30 23:05:53.755594 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.755492    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 23:05:53.755594 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.755532    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 23:05:53.755594 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.755593    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 23:05:53.756343 ip-10-0-133-110 systemd[1]: Started Kubernetes Kubelet.
Oct 30 23:05:53.757131 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.757070    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 23:05:53.757889 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.757873    2576 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 23:05:53.759267 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.759241    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 23:05:53.761256 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.761236    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 23:05:53.761672 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.761655    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 23:05:53.761799 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.761773    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:53.762291 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762274    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 23:05:53.762291 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762275    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 23:05:53.762412 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762298    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 23:05:53.762412 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762361    2576 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 23:05:53.762412 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762371    2576 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 23:05:53.762500 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762458    2576 factory.go:55] Registering systemd factory
Oct 30 23:05:53.762500 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762475    2576 factory.go:223] Registration of the systemd container factory successfully
Oct 30 23:05:53.762716 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762703    2576 factory.go:153] Registering CRI-O factory
Oct 30 23:05:53.762716 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762715    2576 factory.go:223] Registration of the crio container factory successfully
Oct 30 23:05:53.762829 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762764    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 23:05:53.762829 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762778    2576 factory.go:103] Registering Raw factory
Oct 30 23:05:53.762829 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.762788    2576 manager.go:1199] Started watching for new ooms in manager
Oct 30 23:05:53.764325 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.764312    2576 manager.go:319] Starting recovery of all containers
Oct 30 23:05:53.774890 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.774870    2576 manager.go:324] Recovery completed
Oct 30 23:05:53.779015 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.779000    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.780684 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.780598    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.780745 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.780701    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.780745 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.780713    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.781189 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.781175    2576 cpu_manager.go:226] "Starting" policy="none"
Oct 30 23:05:53.781189 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.781188    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 23:05:53.781273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.781204    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 23:05:53.781273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.781180    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.782039 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.782026    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.782096 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.782050    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.782096 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.782060    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.783471 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.783460    2576 policy_none.go:50] "Start"
Oct 30 23:05:53.783505 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.783474    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 23:05:53.783505 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.783483    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 23:05:53.785561 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.785549    2576 policy_none.go:44] "Start"
Oct 30 23:05:53.827175 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.827139    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 23:05:53.829344 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829329    2576 manager.go:341] "Starting Device Plugin manager"
Oct 30 23:05:53.829420 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.829354    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 23:05:53.829420 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829362    2576 server.go:87] "Starting device plugin registration server"
Oct 30 23:05:53.829662 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829648    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 23:05:53.829737 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829663    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 23:05:53.829803 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829783    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 23:05:53.829911 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829898    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 23:05:53.829911 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.829910    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 23:05:53.830456 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.830337    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 23:05:53.830530 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.830481    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:53.880651 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.880604    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 23:05:53.882497 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.881907    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 23:05:53.882497 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.881928    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 23:05:53.882497 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.881947    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 23:05:53.882497 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.881979    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 23:05:53.899284 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.899263    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-110.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 23:05:53.899284 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.899258    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-110.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 23:05:53.900112 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:53.899248    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-110.us-west-1.compute.internal.18e3713617376b07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-110.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-110.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 23:05:53.755269895 +0000 UTC m=+0.339733813,LastTimestamp:2026-10-30 23:05:53.755269895 +0000 UTC m=+0.339733813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-110.us-west-1.compute.internal,}"
Oct 30 23:05:53.930668 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.930631    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.932606 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.932584    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.932729 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.932647    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.932729 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.932663    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.932729 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.932693    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:53.982256 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.982220    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"]
Oct 30 23:05:53.982412 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.982287    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.983254 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.983233    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.983355 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.983270    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.983355 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.983282    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.985397 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.985384    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.985550 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.985535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:53.985587 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.985568    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.986145 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986129    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.986245 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986151    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.986245 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986161    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.986245 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986180    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.986245 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986198    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.986245 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.986207    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:53.988204 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.988188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:53.988271 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.988216    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:53.988981 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.988966    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:53.989073 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.988996    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:53.989073 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:53.989011    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:54.018260 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.018240    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.024574 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.024559    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.035671 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.035653    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 23:05:54.035750 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.035698    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rkgg9"
Oct 30 23:05:54.055208 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.055180    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-110.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 23:05:54.055287 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.055191    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-110.us-west-1.compute.internal.18e3713618bb3bd2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-110.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-110.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-110.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 23:05:53.780685778 +0000 UTC m=+0.365149696,LastTimestamp:2026-10-30 23:05:53.780685778 +0000 UTC m=+0.365149696,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-110.us-west-1.compute.internal,}"
Oct 30 23:05:54.063747 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.063726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.063801 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.063751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.063801 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.063768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.103067 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.103030    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 23:05:54.103192 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.103081    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 23:05:54.164527 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.164527 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.164685 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.164685 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164574    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.164685 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.164685 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.164596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.210333 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.210290    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:05:54.211647 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.211511    2576 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-133-110.us-west-1.compute.internal\" not found" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.265222 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.265198    2576 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-110.us-west-1.compute.internal\" not found" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.320814 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.320792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.327910 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.327895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.412049 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.412026    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:54.412937 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.412916    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:54.413044 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.412949    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:54.413044 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.412967    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:54.413044 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.412996    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.469954 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.469889    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:54.469954 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.469918    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-110.us-west-1.compute.internal\": node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:54.586794 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.586764    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:54.687677 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.687634    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:54.702800 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.702782    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 23:05:54.702900 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:54.702884    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 23:05:54.703037 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.702961    2576 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a69c238be523043a7aa0939d4b6f2b19-5c317881c9fa0372.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-133-110.us-west-1.compute.internal.18e3713618bb8f41\": read tcp 10.0.133.110:55060->3.16.240.75:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-133-110.us-west-1.compute.internal.18e3713618bb8f41  default   5220 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-110.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-110.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-110.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 23:05:53 +0000 UTC,LastTimestamp:2026-10-30 23:05:53.932654917 +0000 UTC m=+0.517118833,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-110.us-west-1.compute.internal,}"
Oct 30 23:05:54.788676 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.788582    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:54.889202 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.889177    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:54.990006 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:54.989977    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:55.040852 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.040791    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:00:54 +0000 UTC" deadline="2028-06-30 18:14:33.082717087 +0000 UTC"
Oct 30 23:05:55.040852 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.040819    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14611h8m38.041900729s"
Oct 30 23:05:55.048950 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.048931    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:05:55.049914 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.049896    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:05:55.050005 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.049932    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:05:55.050005 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.049947    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:05:55.090327 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:55.090301    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:05:55.090830 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.090814    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:05:55.161938 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.161919    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:55.252138 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.252119    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:05:55.254183 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.254169    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:05:55.313940 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.313921    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:05:55.346306 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.346283    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:05:55.414709 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:55.414682    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b2b7fd86cc32af94d49c01fec62d0e.slice/crio-6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361 WatchSource:0}: Error finding container 6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361: Status 404 returned error can't find the container with id 6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361
Oct 30 23:05:55.419311 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.419266    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:05:55.459609 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:55.459589    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda483a0a2f224f7b88a6328294b47ee65.slice/crio-6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3 WatchSource:0}: Error finding container 6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3: Status 404 returned error can't find the container with id 6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3
Oct 30 23:05:55.575857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.575788    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:05:55.742483 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.742454    2576 apiserver.go:52] "Watching apiserver"
Oct 30 23:05:55.763182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.763158    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 23:05:55.853022 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.852951    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 23:05:55.853290 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.853268    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx","openshift-multus/multus-additional-cni-plugins-twrvp","openshift-network-diagnostics/network-check-target-94xqm","openshift-dns/node-resolver-z9k87","openshift-multus/multus-n92qr","openshift-multus/network-metrics-daemon-9mwnl","openshift-network-operator/iptables-alerter-n6trp","openshift-ovn-kubernetes/ovnkube-node-9x2kt","openshift-cluster-node-tuning-operator/tuned-hm45r","openshift-image-registry/node-ca-h2t9s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal","kube-system/global-pull-secret-syncer-6wk6h","kube-system/konnectivity-agent-jqqzd","kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"]
Oct 30 23:05:55.857160 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.857142    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.859443 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.859415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.861573 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.861555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:55.861678 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:55.861613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:05:55.864045 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.864025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.867051 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.867031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.869376 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.869356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:55.869473 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:55.869426    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:05:55.873446 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.873161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.874473 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.874453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:55.876483 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.876574 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876574 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876574 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876574 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876798 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876798 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876798 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876798 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876798 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.876964 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct66p\" (UniqueName: \"kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.876964 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876964 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876964 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.876964 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.876978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mcmg\" (UniqueName: \"kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:55.877152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.877597 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.877435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.879897 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.879881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.882466 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.882445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:55.882547 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:55.882527    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:05:55.884668 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.884647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:55.887371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.887325    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"a483a0a2f224f7b88a6328294b47ee65","Type":"ContainerStarted","Data":"6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3"}
Oct 30 23:05:55.887817 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.887796    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerStarted","Data":"6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361"}
Oct 30 23:05:55.913377 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.913337    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 23:05:55.913497 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.913403    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.913497 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.913421    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.913630 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.913597    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nlg56\""
Oct 30 23:05:55.915208 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.915184    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 23:05:55.915304 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.915217    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4qgbv\""
Oct 30 23:05:55.915408 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.915315    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 23:05:55.919631 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.919612    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 23:05:55.919837 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.919823    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 23:05:55.919928 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.919916    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t7twr\""
Oct 30 23:05:55.920226 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.920201    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 23:05:55.920226 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.920219    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.920348 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.920231    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.920473 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.920461    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 23:05:55.922771 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.922755    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 23:05:55.922874 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.922790    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.923224 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.923209    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7m4ss\""
Oct 30 23:05:55.923351 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.923339    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.923387 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.923380    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 23:05:55.929426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.929409    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.929426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.929412    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.929566 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.929476    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xqsx\""
Oct 30 23:05:55.930119 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.930098    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4j2qm\""
Oct 30 23:05:55.930119 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.930109    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 23:05:55.930229 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.930143    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.930279 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.930267    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.933092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.933075    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7sr97\""
Oct 30 23:05:55.933163 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.933099    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 23:05:55.962570 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.962553    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 23:05:55.962770 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.962754    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.962882 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.962858    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 23:05:55.963401 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963241    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.963401 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963272    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 23:05:55.963401 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963356    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 23:05:55.963651 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963412    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ldcvv\""
Oct 30 23:05:55.963651 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963463    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-46zpf\""
Oct 30 23:05:55.963758 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.963683    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 23:05:55.978329 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.978468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.978468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5b7\" (UniqueName: \"kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.978468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.978468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szs8p\" (UniqueName: \"kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.978468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978465    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978700    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.978776 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct66p\" (UniqueName: \"kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.978977    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.979092 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979186    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979403    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 23:05:55.979426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979506    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcw7l\" (UniqueName: \"kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.979857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gn2h\" (UniqueName: \"kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.979995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980096    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980225    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqngl\" (UniqueName: \"kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:55.980441 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980280    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980375    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x75n\" (UniqueName: \"kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mcmg\" (UniqueName: \"kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.981287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980868    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.980990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqlq7\" (UniqueName: \"kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981257    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981311    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.981857 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:55.982409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.981749    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.983221 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.983204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:55.983312 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:55.983296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:56.017744 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.017706    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 23:05:56.017855 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.017783    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjnqp"
Oct 30 23:05:56.037367 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.037345    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:05:56.037367 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.037365    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:05:56.037479 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.037376    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:56.037479 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.037436    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:05:56.537422607 +0000 UTC m=+3.121886527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:56.039067 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.039049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct66p\" (UniqueName: \"kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:56.040877 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.040862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mcmg\" (UniqueName: \"kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:56.082189 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082265 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.082265 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082265 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082293    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082424 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcw7l\" (UniqueName: \"kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082476    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082555    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082693    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn2h\" (UniqueName: \"kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082714    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.082924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqngl\" (UniqueName: \"kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082920    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x75n\" (UniqueName: \"kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.083757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqlq7\" (UniqueName: \"kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083290    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.082870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.083434    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083471    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.083510    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:56.583490797 +0000 UTC m=+3.167954708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083647    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.084560 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083657    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.083855    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083905    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083934    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.083991    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.084014    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:56.583996075 +0000 UTC m=+3.168459982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.085169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084260    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5b7\" (UniqueName: \"kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084327    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szs8p\" (UniqueName: \"kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084564    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.085654 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.086182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.086182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.086182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.084775    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.086182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.085205    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.086182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.085531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.144793 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.144737    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x75n\" (UniqueName: \"kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:56.144925 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.144902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqngl\" (UniqueName: \"kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.145030 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.145008    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn2h\" (UniqueName: \"kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.145295 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.145276    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcw7l\" (UniqueName: \"kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.145712 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.145641    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqlq7\" (UniqueName: \"kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.145797 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.145780    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5b7\" (UniqueName: \"kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.145853 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.145837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szs8p\" (UniqueName: \"kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.170433 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.170409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:05:56.176878 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.176860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:05:56.180996 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.180961    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413fb1a4_8787_4838_89bb_2f08bc170795.slice/crio-c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b WatchSource:0}: Error finding container c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b: Status 404 returned error can't find the container with id c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b
Oct 30 23:05:56.185743 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.185716    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode729c6bb_7337_4107_9833_b75ca14a82ab.slice/crio-6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d WatchSource:0}: Error finding container 6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d: Status 404 returned error can't find the container with id 6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d
Oct 30 23:05:56.197851 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.197836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n92qr"
Oct 30 23:05:56.198950 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.198932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:05:56.203864 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.203845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:05:56.206159 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.206143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:05:56.207785 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.207760    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3bcdb3_39da_41d5_9ebf_59116a07baf9.slice/crio-4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed WatchSource:0}: Error finding container 4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed: Status 404 returned error can't find the container with id 4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed
Oct 30 23:05:56.212121 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.212097    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f381dd_faeb_4e5a_bf51_c0adfb0837e3.slice/crio-98be0979ba2c4b8c4d21f2eb0dc20d2e356e0f4d65ee8219dc20be4a43fc0166 WatchSource:0}: Error finding container 98be0979ba2c4b8c4d21f2eb0dc20d2e356e0f4d65ee8219dc20be4a43fc0166: Status 404 returned error can't find the container with id 98be0979ba2c4b8c4d21f2eb0dc20d2e356e0f4d65ee8219dc20be4a43fc0166
Oct 30 23:05:56.215845 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.215821    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:05:56.217146 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.217123    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f02514a_3fb9_4bce_adec_87f1e75304a7.slice/crio-22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e WatchSource:0}: Error finding container 22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e: Status 404 returned error can't find the container with id 22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e
Oct 30 23:05:56.219531 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.219508    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb296a934_af68_4984_8c70_0561822d5f17.slice/crio-d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c WatchSource:0}: Error finding container d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c: Status 404 returned error can't find the container with id d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c
Oct 30 23:05:56.225781 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.225752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:05:56.228118 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.228097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:05:56.229757 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.229715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:05:56.235785 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.235764    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8effbcce_e26d_409a_8537_ee344af6f563.slice/crio-83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd WatchSource:0}: Error finding container 83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd: Status 404 returned error can't find the container with id 83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd
Oct 30 23:05:56.238354 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.238334    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddd2b94_9f61_44bb_a171_ade17ebc3f2a.slice/crio-bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5 WatchSource:0}: Error finding container bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5: Status 404 returned error can't find the container with id bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5
Oct 30 23:05:56.241249 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:05:56.241225    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18d2b48_cfd3_4963_89e3_468f7a468c71.slice/crio-95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a WatchSource:0}: Error finding container 95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a: Status 404 returned error can't find the container with id 95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a
Oct 30 23:05:56.588689 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.588577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:56.588689 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.588663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.588708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588736    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588792    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:57.588794957 +0000 UTC m=+4.173258883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588837    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:57.588825686 +0000 UTC m=+4.173289593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588853    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588878    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:05:56.588889 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588893    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:56.589185 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:56.588968    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:05:57.588950193 +0000 UTC m=+4.173414115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:56.891254 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.891148    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2t9s" event={"ID":"413fb1a4-8787-4838-89bb-2f08bc170795","Type":"ContainerStarted","Data":"c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b"}
Oct 30 23:05:56.893165 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.893134    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerStarted","Data":"95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a"}
Oct 30 23:05:56.894695 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.894672    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx" event={"ID":"eddd2b94-9f61-44bb-a171-ade17ebc3f2a","Type":"ContainerStarted","Data":"bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5"}
Oct 30 23:05:56.896524 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.896500    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6trp" event={"ID":"b296a934-af68-4984-8c70-0561822d5f17","Type":"ContainerStarted","Data":"d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c"}
Oct 30 23:05:56.897823 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.897793    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n92qr" event={"ID":"bd3bcdb3-39da-41d5-9ebf-59116a07baf9","Type":"ContainerStarted","Data":"4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed"}
Oct 30 23:05:56.899173 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.899151    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jqqzd" event={"ID":"e729c6bb-7337-4107-9833-b75ca14a82ab","Type":"ContainerStarted","Data":"6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d"}
Oct 30 23:05:56.901243 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.901217    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9k87" event={"ID":"8effbcce-e26d-409a-8537-ee344af6f563","Type":"ContainerStarted","Data":"83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd"}
Oct 30 23:05:56.902827 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.902800    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e"}
Oct 30 23:05:56.904050 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:56.904024    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hm45r" event={"ID":"49f381dd-faeb-4e5a-bf51-c0adfb0837e3","Type":"ContainerStarted","Data":"98be0979ba2c4b8c4d21f2eb0dc20d2e356e0f4d65ee8219dc20be4a43fc0166"}
Oct 30 23:05:57.022194 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.022139    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:00:56 +0000 UTC" deadline="2028-07-10 04:38:12.769000612 +0000 UTC"
Oct 30 23:05:57.022194 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.022188    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14837h32m15.746816578s"
Oct 30 23:05:57.596658 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.596604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:57.596871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.596680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:57.596871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.596725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:57.596871 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.596867    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:05:57.597048 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.596914    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:05:57.597048 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.596930    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:57.597048 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.596986    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:05:59.596967396 +0000 UTC m=+6.181431305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:57.597216 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.597064    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:57.597216 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.597101    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:59.597089404 +0000 UTC m=+6.181553314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:57.597216 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.597160    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:57.597378 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.597285    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:05:59.597182638 +0000 UTC m=+6.181646546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:57.884979 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.884904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:57.885143 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.885031    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:05:57.885143 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.885122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:57.885272 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.885211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:05:57.885330 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:57.885275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:57.885379 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:57.885353    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:05:58.023154 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:58.023105    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:00:56 +0000 UTC" deadline="2028-06-03 21:42:43.156081944 +0000 UTC"
Oct 30 23:05:58.023154 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:58.023153    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13966h36m45.132933687s"
Oct 30 23:05:59.618203 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.618161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.618235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.618278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618414    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618476    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:03.618457943 +0000 UTC m=+10.202921855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618586    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618607    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618621    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:59.618712 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618658    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:06:03.618646237 +0000 UTC m=+10.203110147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:05:59.619152 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618740    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:59.619152 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.618775    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:03.618763968 +0000 UTC m=+10.203227878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:05:59.886289 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.886050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:05:59.886427 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.886404    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:05:59.886496 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.886447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:05:59.886562 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.886543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:05:59.886646 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.886602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:05:59.886725 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:05:59.886710    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:05:59.928721 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:05:59.927877    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"a483a0a2f224f7b88a6328294b47ee65","Type":"ContainerStarted","Data":"127a31717f05f6266c4627362cd760489d39481ef5d21a2698a1aa56f40af411"}
Oct 30 23:06:00.935398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:00.934420    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="e723569ced525a7baa65a14887f07d425268d1515a47486dcb1f8477a1bd1ad6" exitCode=0
Oct 30 23:06:00.935398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:00.934535    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"e723569ced525a7baa65a14887f07d425268d1515a47486dcb1f8477a1bd1ad6"}
Oct 30 23:06:00.946137 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:00.946106    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6b2b7fd86cc32af94d49c01fec62d0e" containerID="48d80bf93bf306141989005dbab1979304b7d9ba9fa619830398fb32225f83dd" exitCode=0
Oct 30 23:06:00.947249 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:00.947218    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerDied","Data":"48d80bf93bf306141989005dbab1979304b7d9ba9fa619830398fb32225f83dd"}
Oct 30 23:06:01.165522 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.164650    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal" podStartSLOduration=6.164629328 podStartE2EDuration="6.164629328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:00.051797143 +0000 UTC m=+6.636261075" watchObservedRunningTime="2026-10-30 23:06:01.164629328 +0000 UTC m=+7.749093249"
Oct 30 23:06:01.884767 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.884656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:01.884924 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:01.884785    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:01.884924 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.884867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:01.885027 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:01.884955    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:01.885027 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.885008    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:01.885129 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:01.885070    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:01.957119 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.957081    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerStarted","Data":"e9721300e619360075ea64b15b055cb09ae97fe6961f7ea9b65370342bb0db69"}
Oct 30 23:06:01.964088 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:01.964056    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jqqzd" event={"ID":"e729c6bb-7337-4107-9833-b75ca14a82ab","Type":"ContainerStarted","Data":"a04e67dc0ac153825a893690936d0d39a2a7930c7216b0d1b3161cc4cf51a6bf"}
Oct 30 23:06:02.184972 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:02.184872    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" podStartSLOduration=7.184852093 podStartE2EDuration="7.184852093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:02.071851611 +0000 UTC m=+8.656315541" watchObservedRunningTime="2026-10-30 23:06:02.184852093 +0000 UTC m=+8.769316022"
Oct 30 23:06:02.970360 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:02.969877    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2t9s" event={"ID":"413fb1a4-8787-4838-89bb-2f08bc170795","Type":"ContainerStarted","Data":"94ad2daeea87e18094f7db097496e94bd9e23fb8da57332bcbdcd71e7d9911ca"}
Oct 30 23:06:03.083468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.083208    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jqqzd" podStartSLOduration=3.845363755 podStartE2EDuration="9.083185335s" totalImagesPullingTime="5.23782158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:02.185923513 +0000 UTC m=+8.770387443" watchObservedRunningTime="2026-10-30 23:06:03.083185335 +0000 UTC m=+9.667649263"
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.657174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.657239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.657279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657413    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657474    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:11.657453983 +0000 UTC m=+18.241917908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657563    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657577    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657589    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657639    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:06:11.657626961 +0000 UTC m=+18.242090880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657698    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:03.657789 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.657731    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:11.657721386 +0000 UTC m=+18.242185297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.886419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.886554    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.886638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.886711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.886753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:03.886871 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:03.886828    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:03.977690 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:03.976963    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx" event={"ID":"eddd2b94-9f61-44bb-a171-ade17ebc3f2a","Type":"ContainerStarted","Data":"5192cb762f4a8413def030ae17342dae704f2411bc43d52ee5052619b8460876"}
Oct 30 23:06:05.086841 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.086669    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 23:06:05.840959 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.840854    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:06:05.086688206Z","UUID":"bfe81307-5ba6-4714-b40b-a865424b3794","Handler":null,"Name":"","Endpoint":""}
Oct 30 23:06:05.844172 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.842705    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 23:06:05.844172 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.842741    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 23:06:05.885716 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.885681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:05.885852 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:05.885817    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:05.886103 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.886064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:05.886182 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:05.886164    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:05.888700 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.888670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:05.888822 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:05.888786    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:05.984171 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.984133    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="9c49f29beb73bf325ce48af13965b537ace6d8ccd00f588f6b861255afde2db6" exitCode=0
Oct 30 23:06:05.984330 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.984221    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"9c49f29beb73bf325ce48af13965b537ace6d8ccd00f588f6b861255afde2db6"}
Oct 30 23:06:05.990346 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.990320    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx" event={"ID":"eddd2b94-9f61-44bb-a171-ade17ebc3f2a","Type":"ContainerStarted","Data":"375d829b6d45fa59d68a27f12528eab1a94124f93b4233c0c1684633dec36d34"}
Oct 30 23:06:05.993722 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.993696    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n92qr" event={"ID":"bd3bcdb3-39da-41d5-9ebf-59116a07baf9","Type":"ContainerStarted","Data":"32685debec641d54458816f4723d138898016f34d305991015beb90a51f27ae6"}
Oct 30 23:06:05.996666 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:05.996645    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9k87" event={"ID":"8effbcce-e26d-409a-8537-ee344af6f563","Type":"ContainerStarted","Data":"f5feaeccd11ebe12dcd9738b7f24fc150646623d619c943b5a2244eda135c7b6"}
Oct 30 23:06:06.021452 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:06.021429    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:06:06.022167 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:06.022147    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:06:06.116373 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:06.116312    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h2t9s" podStartSLOduration=5.901211362 podStartE2EDuration="12.116290262s" totalImagesPullingTime="6.2150789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:03.083943828 +0000 UTC m=+9.668407756" watchObservedRunningTime="2026-10-30 23:06:06.116290262 +0000 UTC m=+12.700754190"
Oct 30 23:06:06.232759 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:06.232659    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-n92qr" podStartSLOduration=3.499679723 podStartE2EDuration="12.232644889s" totalImagesPullingTime="8.732965166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:06.231878773 +0000 UTC m=+12.816342699" watchObservedRunningTime="2026-10-30 23:06:06.232644889 +0000 UTC m=+12.817108815"
Oct 30 23:06:06.343914 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:06.343849    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9k87" podStartSLOduration=2.417046664 podStartE2EDuration="11.343830134s" totalImagesPullingTime="8.92678347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:06.343655846 +0000 UTC m=+12.928119773" watchObservedRunningTime="2026-10-30 23:06:06.343830134 +0000 UTC m=+12.928294063"
Oct 30 23:06:07.003219 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.003185    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx" event={"ID":"eddd2b94-9f61-44bb-a171-ade17ebc3f2a","Type":"ContainerStarted","Data":"03ec702aafc7d1a45dcee9e0d84c720109994afa947d1bc9c04a02c69011fc5a"}
Oct 30 23:06:07.005807 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.005775    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6trp" event={"ID":"b296a934-af68-4984-8c70-0561822d5f17","Type":"ContainerStarted","Data":"d79fccd2e5a565945e50b7d817ee1de560727aefa01f4f5b824570bd2f3264a4"}
Oct 30 23:06:07.122016 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.121959    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx" podStartSLOduration=3.23330361 podStartE2EDuration="13.12193954s" totalImagesPullingTime="9.88863593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:07.121013379 +0000 UTC m=+13.705477307" watchObservedRunningTime="2026-10-30 23:06:07.12193954 +0000 UTC m=+13.706403470"
Oct 30 23:06:07.232909 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.232857    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n6trp" podStartSLOduration=4.151280773 podStartE2EDuration="13.232838356s" totalImagesPullingTime="9.081557583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:07.232634958 +0000 UTC m=+13.817098883" watchObservedRunningTime="2026-10-30 23:06:07.232838356 +0000 UTC m=+13.817302284"
Oct 30 23:06:07.883173 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.883140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:07.883173 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.883156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:07.883393 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:07.883330    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:07.883393 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:07.883378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:07.883507 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:07.883459    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:07.883558 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:07.883526    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:08.010207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:08.010169    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hm45r" event={"ID":"49f381dd-faeb-4e5a-bf51-c0adfb0837e3","Type":"ContainerStarted","Data":"b2d9eda09d0ae1f7004062719428e5c57060bd049c812df43474ed9594fc6dd3"}
Oct 30 23:06:08.012733 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:08.012701    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="8eb95094dbb0755f0fe8f9a1806722d665a56a0d7343e195cbc6ff2c0d61fa23" exitCode=0
Oct 30 23:06:08.012866 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:08.012762    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"8eb95094dbb0755f0fe8f9a1806722d665a56a0d7343e195cbc6ff2c0d61fa23"}
Oct 30 23:06:08.125723 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:08.125668    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hm45r" podStartSLOduration=3.149609395 podStartE2EDuration="14.125654659s" totalImagesPullingTime="10.976045264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:08.125081638 +0000 UTC m=+14.709545569" watchObservedRunningTime="2026-10-30 23:06:08.125654659 +0000 UTC m=+14.710118586"
Oct 30 23:06:09.882965 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:09.882779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:09.882965 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:09.882797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:09.882965 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:09.882900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:09.882965 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:09.882920    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:09.883634 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:09.882999    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:09.883634 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:09.883103    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:10.020212 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:10.020172    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="1b65845a621c0935a868a630bee33020208f2038a402b07072d38c232a137f54" exitCode=0
Oct 30 23:06:10.020373 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:10.020227    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"1b65845a621c0935a868a630bee33020208f2038a402b07072d38c232a137f54"}
Oct 30 23:06:11.737080 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.736879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.737124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737036    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.737175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737222    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:27.737200898 +0000 UTC m=+34.321664826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737279    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737315    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:27.737303498 +0000 UTC m=+34.321767405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737333    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737356    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737369    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:11.737515 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.737416    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:06:27.737401047 +0000 UTC m=+34.321864977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.884789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.884834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.884959    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.885065    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:11.885158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:11.885354 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:11.885255    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:12.028273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028253    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:06:12.028637 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028592    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f02514a-3fb9-4bce-adec-87f1e75304a7" containerID="51624f0865bf0052958d142302a7715dd28cb6f540b05e0edcedeba318490164" exitCode=1
Oct 30 23:06:12.028717 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028636    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"bd97a58f3f0de0513435605e59fbb6e74aba4325fbde1beae5381df33954dba7"}
Oct 30 23:06:12.028717 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028700    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"b9eba3b92a268524cb7670412e07a1f6349efbda9694dfd043c234cc0e364498"}
Oct 30 23:06:12.028815 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028801    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerDied","Data":"51624f0865bf0052958d142302a7715dd28cb6f540b05e0edcedeba318490164"}
Oct 30 23:06:12.028850 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:12.028839    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"1ceebfacfd7cd18f66c52635c5905754ecda590f603becd92c8344b867612686"}
Oct 30 23:06:13.033705 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.033516    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:06:13.034286 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.034128    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"9e8bab27fecfd098f8d5222778afb9ba23950c73774efbbc3d1b438714685ce6"}
Oct 30 23:06:13.034286 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.034204    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"f4f14778b24de35eed474b6a2bebf4432e4b0bafbb59326c51e336fc32ff088c"}
Oct 30 23:06:13.036766 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.036743    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="7f36fa7094529f5f4184f7edb45fb37516a1f1e1ffac01d63d73162bbb0b710e" exitCode=0
Oct 30 23:06:13.036879 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.036785    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"7f36fa7094529f5f4184f7edb45fb37516a1f1e1ffac01d63d73162bbb0b710e"}
Oct 30 23:06:13.884069 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.884033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:13.884260 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.884121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:13.884260 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:13.884164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:13.884260 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:13.884166    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:13.884260 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:13.884240    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:13.884379 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:13.884333    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:14.041856 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:14.041826    2576 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="e95d015334effec0f973b046c5a5e5a9acd1f3b643e8c3c8da887a9fac245a05" exitCode=0
Oct 30 23:06:14.041856 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:14.041859    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerDied","Data":"e95d015334effec0f973b046c5a5e5a9acd1f3b643e8c3c8da887a9fac245a05"}
Oct 30 23:06:15.046681 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.046652    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:06:15.047127 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.047019    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"3b57f9477995204c4dc947fcfaa09952d9f070e80ed12fe12b3f53925918c081"}
Oct 30 23:06:15.049963 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.049939    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twrvp" event={"ID":"f18d2b48-cfd3-4963-89e3-468f7a468c71","Type":"ContainerStarted","Data":"2e8a0a541e3c8497f99521ef3aa8ee85e69e78a61a1e21b0d74016d458ec6027"}
Oct 30 23:06:15.168524 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.166820    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-twrvp" podStartSLOduration=8.632527673 podStartE2EDuration="21.166804012s" totalImagesPullingTime="12.534276339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:15.166165896 +0000 UTC m=+21.750629823" watchObservedRunningTime="2026-10-30 23:06:15.166804012 +0000 UTC m=+21.751267940"
Oct 30 23:06:15.882937 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.882900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:15.882937 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.882921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:15.883296 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:15.883052    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:15.883296 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:15.883090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:15.883296 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:15.883161    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:15.883296 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:15.883215    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:17.057261 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.057231    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:06:17.058093 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.057630    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"f5aa4af60a7cf736417eb16b2f051c155e6a6947319b74996470ff4c54b888c9"}
Oct 30 23:06:17.058093 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.057904    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:17.058093 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.058088    2576 scope.go:122] "RemoveContainer" containerID="51624f0865bf0052958d142302a7715dd28cb6f540b05e0edcedeba318490164"
Oct 30 23:06:17.074100 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.074084    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:17.883279 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.883031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:17.883420 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.883047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:17.883420 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:17.883394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:17.883521 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:17.883090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:17.883521 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:17.883466    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:17.883593 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:17.883519    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:18.063688 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.063662    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:06:18.064103 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.064026    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" event={"ID":"5f02514a-3fb9-4bce-adec-87f1e75304a7","Type":"ContainerStarted","Data":"88d5e81a1cc7585f14bf17ed82ba02069946b479ebea8a421f16f4eab74f5f10"}
Oct 30 23:06:18.064222 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.064203    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:18.064280 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.064254    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:18.079551 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.079525    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:18.190008 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:18.189923    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt" podStartSLOduration=8.732456014 podStartE2EDuration="24.189907952s" totalImagesPullingTime="15.457451938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:18.189206989 +0000 UTC m=+24.773670916" watchObservedRunningTime="2026-10-30 23:06:18.189907952 +0000 UTC m=+24.774371885"
Oct 30 23:06:19.141141 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.141070    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wk6h"]
Oct 30 23:06:19.141541 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.141183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:19.141541 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:19.141280    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:19.144745 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.144719    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94xqm"]
Oct 30 23:06:19.144878 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.144812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:19.144924 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:19.144905    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:19.145503 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.145481    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mwnl"]
Oct 30 23:06:19.145588 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:19.145575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:19.145716 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:19.145697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:20.883110 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:20.883035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:20.883507 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:20.883130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:20.883507 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:20.883221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:20.883507 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:20.883239    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:20.883507 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:20.883300    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:20.883507 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:20.883353    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:22.882741 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:22.882667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:22.882741 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:22.882702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:22.883191 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:22.882667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:22.883191 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:22.882790    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:22.883191 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:22.882826    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:22.883191 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:22.882909    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:24.883131 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:24.883035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:24.883581 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:24.883165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:24.883581 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:24.883170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:24.883581 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:24.883197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:24.883581 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:24.883295    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:24.883581 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:24.883383    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:25.136264 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:25.136201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9k87_8effbcce-e26d-409a-8537-ee344af6f563/dns-node-resolver/0.log"
Oct 30 23:06:25.651186 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:25.651148    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:06:25.651380 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:25.651308    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:06:25.652049 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:25.652027    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:06:25.947172 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:25.947106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h2t9s_413fb1a4-8787-4838-89bb-2f08bc170795/node-ca/0.log"
Oct 30 23:06:26.882143 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:26.882111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:26.882312 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:26.882218    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:26.882312 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:26.882224    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:26.882385 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:26.882311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:26.882385 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:26.882222    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:26.882446 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:26.882393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:27.750848 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:27.750812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:27.750848 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:27.750852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:27.750877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.750953    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.750961    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.750967    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.750978    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.750989    2576 projected.go:196] Error preparing data for projected volume kube-api-access-mn2r4 for pod openshift-network-diagnostics/network-check-target-94xqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.751009    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret podName:fd46d589-b55e-4971-9abc-1595f7d4a900 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:59.750994759 +0000 UTC m=+66.335458664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret") pod "global-pull-secret-syncer-6wk6h" (UID: "fd46d589-b55e-4971-9abc-1595f7d4a900") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.751024    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4 podName:e9f2ae1d-bfae-48b3-869b-b779f230415a nodeName:}" failed. No retries permitted until 2026-10-30 23:06:59.751013478 +0000 UTC m=+66.335477396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn2r4" (UniqueName: "kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4") pod "network-check-target-94xqm" (UID: "e9f2ae1d-bfae-48b3-869b-b779f230415a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:06:27.751310 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:27.751038    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs podName:767ef969-8394-4941-84fb-beda11cc4709 nodeName:}" failed. No retries permitted until 2026-10-30 23:06:59.751031646 +0000 UTC m=+66.335495551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs") pod "network-metrics-daemon-9mwnl" (UID: "767ef969-8394-4941-84fb-beda11cc4709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:06:28.882869 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:28.882838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:28.882869 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:28.882870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:28.882869 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:28.882873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:28.883435 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:28.882965    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:28.883435 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:28.883096    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:28.883435 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:28.883174    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:30.882496 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:30.882461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:30.883021 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:30.882553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:30.883021 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:30.882562    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:30.883021 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:30.882668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:30.883021 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:30.882747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:30.883021 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:30.882838    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:32.882199 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:32.882167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:32.882586 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:32.882220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:32.882586 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:32.882225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:32.882586 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:32.882294    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:32.882586 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:32.882351    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:32.882586 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:32.882403    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:34.882538 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:34.882496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:34.883050 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:34.882555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:34.883050 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:34.882586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:34.883050 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:34.882817    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:34.883195 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:34.883138    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:34.883407 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:34.883384    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:36.882721 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:36.882679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:36.882721 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:36.882718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:36.883246 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:36.882718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:36.883246 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:36.882806    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wk6h" podUID="fd46d589-b55e-4971-9abc-1595f7d4a900"
Oct 30 23:06:36.883246 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:36.882873    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94xqm" podUID="e9f2ae1d-bfae-48b3-869b-b779f230415a"
Oct 30 23:06:36.883246 ip-10-0-133-110 kubenswrapper[2576]: E1030 23:06:36.882954    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mwnl" podUID="767ef969-8394-4941-84fb-beda11cc4709"
Oct 30 23:06:38.738171 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.738147    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeReady"
Oct 30 23:06:38.738523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.738257    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 23:06:38.851634 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.851591    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4krlr"]
Oct 30 23:06:38.853426 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.853410    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dr89q"]
Oct 30 23:06:38.853553 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.853535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:38.855093 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.855076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:38.863902 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.863881    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bwwqq"]
Oct 30 23:06:38.865605 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.865589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:38.882769 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.882744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:38.882769 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.882757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:38.882915 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.882856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:38.895162 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.895128    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4krlr"]
Oct 30 23:06:38.901963 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.901943    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr89q"]
Oct 30 23:06:38.907481 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.907462    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 23:06:38.907481 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.907473    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cqcdm\""
Oct 30 23:06:38.907643 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.907506    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 23:06:38.907643 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.907525    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-l6bwx\""
Oct 30 23:06:38.907716 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.907698    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 23:06:38.931010 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:38.930986    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bwwqq"]
Oct 30 23:06:39.008247 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008208    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 23:06:39.008417 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008283    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 23:06:39.008417 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008339    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tw7s4\""
Oct 30 23:06:39.008417 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008384    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 23:06:39.008545 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008458    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 23:06:39.008545 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008469    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 23:06:39.008545 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008522    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 23:06:39.008728 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008710    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fbzzd\""
Oct 30 23:06:39.008789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008755    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 23:06:39.008789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008762    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 23:06:39.008789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008758    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-trr47\""
Oct 30 23:06:39.008908 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008780    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v482q\""
Oct 30 23:06:39.008908 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008793    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 23:06:39.008908 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.008849    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 23:06:39.027406 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcc4k\" (UniqueName: \"kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.027471 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.027471 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.027572 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.027666 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.027724 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.027724 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbn7\" (UniqueName: \"kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.027816 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.027858 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.027858 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hpbp\" (UniqueName: \"kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.027944 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.027868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.128350 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.128350 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbn7\" (UniqueName: \"kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpbp\" (UniqueName: \"kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcc4k\" (UniqueName: \"kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.128556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128533    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.128915 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.128915 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.128915 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.128720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.129064 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.129045    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.129117 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.129070    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.129177 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.129158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.129224 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.129175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.132352 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.132330    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.132470 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.132456    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.132557 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.132539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.185417 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.185362    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpbp\" (UniqueName: \"kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.185568 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.185549    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcc4k\" (UniqueName: \"kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.185880 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.185862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbn7\" (UniqueName: \"kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.466162 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.466077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:39.469786 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.469763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:06:39.476730 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.476710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:06:39.860391 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.858873    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr89q"]
Oct 30 23:06:39.864711 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:39.864684    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb415ec_3e02_40b4_bee6_419ae59a6658.slice/crio-0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec WatchSource:0}: Error finding container 0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec: Status 404 returned error can't find the container with id 0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec
Oct 30 23:06:39.909022 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.908996    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4krlr"]
Oct 30 23:06:39.911307 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:39.911285    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bwwqq"]
Oct 30 23:06:39.912580 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:39.912555    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b78d601_a26c_4cd3_ac5c_eea7b658f07f.slice/crio-5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a WatchSource:0}: Error finding container 5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a: Status 404 returned error can't find the container with id 5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a
Oct 30 23:06:39.915820 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:39.915800    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb29279_c313_451b_bec0_8564faf340ef.slice/crio-6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068 WatchSource:0}: Error finding container 6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068: Status 404 returned error can't find the container with id 6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068
Oct 30 23:06:40.111310 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:40.111229    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwwqq" event={"ID":"1fb29279-c313-451b-bec0-8564faf340ef","Type":"ContainerStarted","Data":"a62b948d6b8b6665f59dde8117b09552c27eb23705dc3a556cfbcc80bc21cf5e"}
Oct 30 23:06:40.111310 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:40.111284    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwwqq" event={"ID":"1fb29279-c313-451b-bec0-8564faf340ef","Type":"ContainerStarted","Data":"6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068"}
Oct 30 23:06:40.112333 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:40.112313    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr89q" event={"ID":"deb415ec-3e02-40b4-bee6-419ae59a6658","Type":"ContainerStarted","Data":"0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec"}
Oct 30 23:06:40.113385 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:40.113367    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4krlr" event={"ID":"6b78d601-a26c-4cd3-ac5c-eea7b658f07f","Type":"ContainerStarted","Data":"5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a"}
Oct 30 23:06:42.122248 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:42.122206    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwwqq" event={"ID":"1fb29279-c313-451b-bec0-8564faf340ef","Type":"ContainerStarted","Data":"5eea6c746957c0509a7721f03d3c326f7d577f4ab1c8bdb4efc23b5fce1ec270"}
Oct 30 23:06:43.127360 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.127317    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwwqq" event={"ID":"1fb29279-c313-451b-bec0-8564faf340ef","Type":"ContainerStarted","Data":"6a13337a1e307affc42371ec02a9e2396da899be2534382ce69ae02c1dad57a5"}
Oct 30 23:06:43.129276 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.129241    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr89q" event={"ID":"deb415ec-3e02-40b4-bee6-419ae59a6658","Type":"ContainerStarted","Data":"771fdf3fe4e4138ada730a50ab3da86b0b929aded16568cbaa7bc6c6489a1f0e"}
Oct 30 23:06:43.131168 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.131146    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4krlr" event={"ID":"6b78d601-a26c-4cd3-ac5c-eea7b658f07f","Type":"ContainerStarted","Data":"74b8f4d565432edfb7a6d3877233cc2b925ebb3a544db26a175bddb492fef231"}
Oct 30 23:06:43.131279 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.131190    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4krlr" event={"ID":"6b78d601-a26c-4cd3-ac5c-eea7b658f07f","Type":"ContainerStarted","Data":"523320c11ade75b44d79bb7c065d49baed84a301324cfc2fdc07f091e54ac7b1"}
Oct 30 23:06:43.131279 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.131270    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:43.388100 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.387998    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bwwqq" podStartSLOduration=2.445114446 podStartE2EDuration="5.387984762s" totalImagesPullingTime="2.942870316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:06:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:43.273515603 +0000 UTC m=+49.857979542" watchObservedRunningTime="2026-10-30 23:06:43.387984762 +0000 UTC m=+49.972448670"
Oct 30 23:06:43.388398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.388376    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-4krlr" podStartSLOduration=3.093593601 podStartE2EDuration="5.388370702s" totalImagesPullingTime="2.294777101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:43.387478018 +0000 UTC m=+49.971941946" watchObservedRunningTime="2026-10-30 23:06:43.388370702 +0000 UTC m=+49.972834629"
Oct 30 23:06:43.501373 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.501314    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dr89q" podStartSLOduration=2.350287839 podStartE2EDuration="5.501296276s" totalImagesPullingTime="3.151008437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:43.501019892 +0000 UTC m=+50.085483818" watchObservedRunningTime="2026-10-30 23:06:43.501296276 +0000 UTC m=+50.085760207"
Oct 30 23:06:43.897427 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.897389    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"]
Oct 30 23:06:43.899565 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.899544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:43.952053 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.952028    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 23:06:43.952167 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.952091    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r7j85\""
Oct 30 23:06:43.957328 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:43.957299    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"]
Oct 30 23:06:44.063471 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:44.063436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-2fm7f\" (UID: \"afdd3a1c-cea6-480a-b43f-adf808299dde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:44.164454 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:44.164382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-2fm7f\" (UID: \"afdd3a1c-cea6-480a-b43f-adf808299dde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:44.167018 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:44.166991    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-2fm7f\" (UID: \"afdd3a1c-cea6-480a-b43f-adf808299dde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:44.211945 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:44.211919    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:44.583034 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:44.583006    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"]
Oct 30 23:06:44.587194 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:44.587170    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafdd3a1c_cea6_480a_b43f_adf808299dde.slice/crio-24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa WatchSource:0}: Error finding container 24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa: Status 404 returned error can't find the container with id 24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa
Oct 30 23:06:45.137595 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:45.137564    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f" event={"ID":"afdd3a1c-cea6-480a-b43f-adf808299dde","Type":"ContainerStarted","Data":"24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa"}
Oct 30 23:06:46.273455 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.273421    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:06:46.275179 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.275164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281240 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281337 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281398 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281495 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.281526 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.281509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.332979 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.332956    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 23:06:46.333522 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.333490    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 23:06:46.333694 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.333668    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 23:06:46.333785 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.333674    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xvjkf\""
Oct 30 23:06:46.333785 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.333682    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 23:06:46.333922 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.333907    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 23:06:46.334783 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.334765    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:06:46.382273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.382846 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.382816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.383132 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.383067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.383132 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.383174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.384800 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.384777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.384909 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.384891    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.437816 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.437758    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 23:06:46.438015 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.438001    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 23:06:46.442578 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.442558    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.443051 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.443034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.583995 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.583950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:46.954541 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:46.954504    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:06:46.983913 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:46.983883    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0fc55f_ed29_4830_a0e2_8214ca25ecb8.slice/crio-d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969 WatchSource:0}: Error finding container d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969: Status 404 returned error can't find the container with id d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969
Oct 30 23:06:47.144189 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:47.144161    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb4968b4d-mm6ms" event={"ID":"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8","Type":"ContainerStarted","Data":"d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969"}
Oct 30 23:06:47.145520 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:47.145492    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f" event={"ID":"afdd3a1c-cea6-480a-b43f-adf808299dde","Type":"ContainerStarted","Data":"19f93ae9bd91df308595c8326688ded4cacb5e5bcec512a15cb951e3544e9a15"}
Oct 30 23:06:47.145741 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:47.145724    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:47.150434 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:47.150414    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:06:47.258855 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:47.258807    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f" podStartSLOduration=2.687683624 podStartE2EDuration="4.258792724s" totalImagesPullingTime="1.5711091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:47.258262215 +0000 UTC m=+53.842726142" watchObservedRunningTime="2026-10-30 23:06:47.258792724 +0000 UTC m=+53.843256651"
Oct 30 23:06:48.507933 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.507898    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"]
Oct 30 23:06:48.510153 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.510132    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.600581 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.600552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.600770 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.600589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.600770 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.600657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xq4g\" (UniqueName: \"kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.600886 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.600797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.612258 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612232    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 23:06:48.612443 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612356    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 23:06:48.612652 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612599    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 23:06:48.612652 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612599    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 23:06:48.612652 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612653    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x648d\""
Oct 30 23:06:48.612872 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.612732    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 23:06:48.663404 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.663372    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"]
Oct 30 23:06:48.701205 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.701179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xq4g\" (UniqueName: \"kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.701358 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.701306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.701358 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.701340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.701464 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.701363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.702118 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.702070    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.704524 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.704495    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.704663 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.704533    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.758997 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.758927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xq4g\" (UniqueName: \"kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:48.823129 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:48.823094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:06:49.199459 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:49.199374    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"]
Oct 30 23:06:49.233786 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:49.233757    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389f431d_8f1c_4f9c_8cac_e270a08b731a.slice/crio-48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0 WatchSource:0}: Error finding container 48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0: Status 404 returned error can't find the container with id 48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0
Oct 30 23:06:50.080505 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:50.080476    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:06:50.157504 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:50.157460    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98" event={"ID":"389f431d-8f1c-4f9c-8cac-e270a08b731a","Type":"ContainerStarted","Data":"48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0"}
Oct 30 23:06:51.161772 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:51.161734    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb4968b4d-mm6ms" event={"ID":"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8","Type":"ContainerStarted","Data":"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"}
Oct 30 23:06:51.163563 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:51.163542    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98" event={"ID":"389f431d-8f1c-4f9c-8cac-e270a08b731a","Type":"ContainerStarted","Data":"564313f23209655433c2ac8911b44867a5e04755f1f8d3334222dc7b52af67f8"}
Oct 30 23:06:51.279190 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:51.279138    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5bb4968b4d-mm6ms" podStartSLOduration=1.953888941 podStartE2EDuration="5.279120236s" totalImagesPullingTime="3.325231295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:51.278414092 +0000 UTC m=+57.862878019" watchObservedRunningTime="2026-10-30 23:06:51.279120236 +0000 UTC m=+57.863584163"
Oct 30 23:06:52.168547 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:52.168510    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98" event={"ID":"389f431d-8f1c-4f9c-8cac-e270a08b731a","Type":"ContainerStarted","Data":"f244cdb0e7ff5fcb1e64d738193ce7482f7bf943cf81ea0ef0cd7788a1629157"}
Oct 30 23:06:52.296693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:52.296638    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98" podStartSLOduration=2.462733301 podStartE2EDuration="4.29660355s" totalImagesPullingTime="1.833870249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:52.296469364 +0000 UTC m=+58.880933291" watchObservedRunningTime="2026-10-30 23:06:52.29660355 +0000 UTC m=+58.881067477"
Oct 30 23:06:53.136166 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:53.136134    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4krlr"
Oct 30 23:06:54.120957 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.120923    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:06:54.124898 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.124882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.146930 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.146904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147054 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.146940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147054 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.146975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147141 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.147114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147181 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.147142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147181 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.147169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147249 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.147188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.147249 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.147204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247725 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247725 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247946 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247946 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247946 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.247946 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.247941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.248151 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.248001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.248151 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.248029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.248253 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.248152    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.248506 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.248489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.248878 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.248829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.249416 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.249387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.250582 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.250553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.250743 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.250724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.328574 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.328532    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 23:06:54.329607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.329578    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:06:54.331112 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.331090    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.339369 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.339336    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.435551 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.435462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:06:54.803084 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.803048    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:06:54.837552 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:54.837522    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f699aea_caae_4dd7_a01d_edfaf2b23387.slice/crio-edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9 WatchSource:0}: Error finding container edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9: Status 404 returned error can't find the container with id edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9
Oct 30 23:06:54.968361 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.968327    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"]
Oct 30 23:06:54.971391 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:54.971376    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.023669 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.023607    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5qktt\""
Oct 30 23:06:55.023669 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.023607    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 23:06:55.023866 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.023698    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 23:06:55.029434 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.029404    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"]
Oct 30 23:06:55.053916 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.053850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.053916 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.053895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.054061 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.054001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.054061 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.054026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc6lz\" (UniqueName: \"kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.101064 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.101033    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"]
Oct 30 23:06:55.107268 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.107241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.114488 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.114460    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2pjh2"]
Oct 30 23:06:55.117360 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.117342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.154912 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.154887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9cz7\" (UniqueName: \"kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.154919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.154957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155345 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155647 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155647 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gs59\" (UniqueName: \"kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155647 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.155647 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155647 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.155833 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.155892 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.155951 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6lz\" (UniqueName: \"kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.155951 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.156050 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.155972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.156418 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.156397    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.157542 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.157521    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.157640 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.157543    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.162348 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.162329    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 23:06:55.162728 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.162647    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wqjlk\""
Oct 30 23:06:55.162728 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.162698    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 23:06:55.163637 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.163593    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 23:06:55.163735 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.163681    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"]
Oct 30 23:06:55.172569 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.172440    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 23:06:55.172862 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.172845    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 23:06:55.172862 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.172857    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 23:06:55.172975 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.172854    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s47dt\""
Oct 30 23:06:55.179095 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.179070    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689bbf5654-hrm8r" event={"ID":"0f699aea-caae-4dd7-a01d-edfaf2b23387","Type":"ContainerStarted","Data":"5b76150f6b9d06741b02bd8a027a194da9ae572e3452778f4c58c3de505a23ff"}
Oct 30 23:06:55.179178 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.179113    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689bbf5654-hrm8r" event={"ID":"0f699aea-caae-4dd7-a01d-edfaf2b23387","Type":"ContainerStarted","Data":"edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9"}
Oct 30 23:06:55.213196 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.213160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6lz\" (UniqueName: \"kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.257212 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.257371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.257371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.257371 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257658 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cz7\" (UniqueName: \"kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257658 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257522    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.257777 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.257952 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.257952 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258055 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.257984    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258055 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258055 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gs59\" (UniqueName: \"kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258343 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258278    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.258502 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258600 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258696 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.258756 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.258909 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.258892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.260579 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.260551    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.260714 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.260692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.260839 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.260822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.260976 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.260955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.285807 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.285781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:06:55.314737 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.314681    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cz7\" (UniqueName: \"kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.314737 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.314710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gs59\" (UniqueName: \"kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.343642 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.341193    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-689bbf5654-hrm8r" podStartSLOduration=1.341162218 podStartE2EDuration="1.341162218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:55.340961434 +0000 UTC m=+61.925425362" watchObservedRunningTime="2026-10-30 23:06:55.341162218 +0000 UTC m=+61.925626146"
Oct 30 23:06:55.423291 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.423253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:06:55.431355 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.431326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:06:55.443636 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:55.443587    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201241b0_a25e_4c89_9d64_c33bde6637c1.slice/crio-6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01 WatchSource:0}: Error finding container 6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01: Status 404 returned error can't find the container with id 6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01
Oct 30 23:06:55.663535 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.663458    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"]
Oct 30 23:06:55.666296 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:55.666269    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50d5730_1bd4_4cea_8915_4a7d9ba6fc02.slice/crio-feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2 WatchSource:0}: Error finding container feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2: Status 404 returned error can't find the container with id feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2
Oct 30 23:06:55.795464 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:55.795437    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"]
Oct 30 23:06:55.799055 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:55.799033    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdb7fa1_ffb5_4147_81a9_fd6c4bcff234.slice/crio-914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914 WatchSource:0}: Error finding container 914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914: Status 404 returned error can't find the container with id 914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914
Oct 30 23:06:56.183841 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.183811    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8" event={"ID":"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02","Type":"ContainerStarted","Data":"7362bab77c3c91e54acd4c020f92125314384e96892265fdc80fbbe964d6d1b7"}
Oct 30 23:06:56.184282 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.183877    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8" event={"ID":"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02","Type":"ContainerStarted","Data":"b0950846d8b8fd43b3d6a4938ff59c2ff59e65bca89cf521f8500c49ec8b3245"}
Oct 30 23:06:56.184282 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.183910    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8" event={"ID":"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02","Type":"ContainerStarted","Data":"feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2"}
Oct 30 23:06:56.184933 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.184914    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz" event={"ID":"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234","Type":"ContainerStarted","Data":"914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914"}
Oct 30 23:06:56.186031 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.186012    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pjh2" event={"ID":"201241b0-a25e-4c89-9d64-c33bde6637c1","Type":"ContainerStarted","Data":"6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01"}
Oct 30 23:06:56.585044 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.585004    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:56.585217 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.585146    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:56.590628 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:56.590597    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:57.191871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.191785    2576 generic.go:356] "Generic (PLEG): container finished" podID="201241b0-a25e-4c89-9d64-c33bde6637c1" containerID="98f4240d28fcd188e77963813fe359a27b577de2932463351ee43d2b90da4b04" exitCode=0
Oct 30 23:06:57.191871 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.191821    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pjh2" event={"ID":"201241b0-a25e-4c89-9d64-c33bde6637c1","Type":"ContainerDied","Data":"98f4240d28fcd188e77963813fe359a27b577de2932463351ee43d2b90da4b04"}
Oct 30 23:06:57.197768 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.197424    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:06:57.302738 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.302709    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:06:57.307659 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.307637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.359952    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.359981    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360045    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360045    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360053    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360076    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 23:06:57.360111 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360076    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 23:06:57.360510 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360172    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 23:06:57.360510 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.360326    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vl5rp\""
Oct 30 23:06:57.378409 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378581 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378581 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378746 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378746 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378746 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378746 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.378931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.378927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.410400 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.410371    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 23:06:57.420873 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.420845    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:06:57.479765 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.479905 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.479905 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.479905 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480035 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480035 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.479959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480035 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480138 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480138 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480138 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480242 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480242 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.480242 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.480221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.483971 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.481855    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.483971 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.483030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.483971 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.483478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.483971 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.483930    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.486022 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.485999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.486328 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.486283    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.486420 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.486380    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.486480 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.486411    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.487182 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.487157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.487421 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.487401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.487696 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.487678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.488420 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.488401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.539152 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.539123    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.640817 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.640793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:06:57.657668 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.657644    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"]
Oct 30 23:06:57.671004 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.670976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.722578    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"]
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.723601    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.723662    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.723837    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.723937    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7utij12jgulav\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.724009    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7fhmg\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.724057    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 23:06:57.724680 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.724161    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 23:06:57.783727 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.783842 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.783842 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.783909 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.783950 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.783950 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.784009 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzsx\" (UniqueName: \"kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.784009 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.783992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.784109 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.784092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.884919 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.884879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885077 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.884933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885077 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.884982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885077 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885077 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885077 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885304 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885304 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885304 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzsx\" (UniqueName: \"kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885853 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885761    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.885999 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.885919    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.887966 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.887939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.888287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.888261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.888444 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.888425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.888718 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.888701    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.889116 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.889096    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.889147 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.889105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:57.942962 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:57.942930    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzsx\" (UniqueName: \"kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:58.010442 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.010407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:06:58.081554 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.081515    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:06:58.084874 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:58.084846    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acc9e4a_82b7_4e08_9927_f4318943b4fd.slice/crio-4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4 WatchSource:0}: Error finding container 4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4: Status 404 returned error can't find the container with id 4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4
Oct 30 23:06:58.197705 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.197670    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pjh2" event={"ID":"201241b0-a25e-4c89-9d64-c33bde6637c1","Type":"ContainerStarted","Data":"2c918105c9bca46df7e9e1fd49cbbaddcefebe83eeae332036f5bc3ddc802cef"}
Oct 30 23:06:58.198222 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.197734    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pjh2" event={"ID":"201241b0-a25e-4c89-9d64-c33bde6637c1","Type":"ContainerStarted","Data":"577247193fa87efb4308dc56ea55e61c2eed6f40ad9d973910d47f4205c1033e"}
Oct 30 23:06:58.203782 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.203687    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8" event={"ID":"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02","Type":"ContainerStarted","Data":"0fc1e4b2e84e1c81a2ddb68f21e47d190244a2bba480296e043902554ed51fde"}
Oct 30 23:06:58.206929 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.206783    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz" event={"ID":"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234","Type":"ContainerStarted","Data":"ca51b75cdb87edd81306b633113a990c64400f08519264e23411fe47a87b16e3"}
Oct 30 23:06:58.206929 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.206856    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz" event={"ID":"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234","Type":"ContainerStarted","Data":"3d8316837cdbfff8384f4762d17aeecf462216f213d2766e59b019f33897600d"}
Oct 30 23:06:58.206929 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.206884    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz" event={"ID":"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234","Type":"ContainerStarted","Data":"faf458614380e6243cfad2500bf2c721ca1845f8d9ce2f193ad81cd75c3528c2"}
Oct 30 23:06:58.208744 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.208719    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4"}
Oct 30 23:06:58.317693 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.317575    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2pjh2" podStartSLOduration=1.777268092 podStartE2EDuration="3.317555199s" totalImagesPullingTime="1.450640654s" totalInitContainerRuntime="89.646453ms" isStatefulPod=true podCreationTimestamp="2026-10-30 23:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:58.317019447 +0000 UTC m=+64.901483376" watchObservedRunningTime="2026-10-30 23:06:58.317555199 +0000 UTC m=+64.902019127"
Oct 30 23:06:58.398288 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.398255    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"]
Oct 30 23:06:58.401334 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:06:58.401306    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64763c7a_6a43_4764_9fc5_b1e16d1f6c80.slice/crio-a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7 WatchSource:0}: Error finding container a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7: Status 404 returned error can't find the container with id a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7
Oct 30 23:06:58.432117 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.432075    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8" podStartSLOduration=2.829181827 podStartE2EDuration="4.432061336s" totalImagesPullingTime="1.602879509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:58.430932508 +0000 UTC m=+65.015396438" watchObservedRunningTime="2026-10-30 23:06:58.432061336 +0000 UTC m=+65.016525262"
Oct 30 23:06:58.551707 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:58.551651    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz" podStartSLOduration=1.7557824929999999 podStartE2EDuration="3.551636311s" totalImagesPullingTime="1.795853818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:58.550177344 +0000 UTC m=+65.134641269" watchObservedRunningTime="2026-10-30 23:06:58.551636311 +0000 UTC m=+65.136100232"
Oct 30 23:06:59.214920 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.214877    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7"}
Oct 30 23:06:59.783233 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.783193    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"]
Oct 30 23:06:59.786722 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.786699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:06:59.805752 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.805719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:59.805865 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.805770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:59.805865 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.805809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:59.838978 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.838897    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 23:06:59.841738 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.841710    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jqp2d\""
Oct 30 23:06:59.843149 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.843126    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"]
Oct 30 23:06:59.857176 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.857150    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 23:06:59.857176 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.857149    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 23:06:59.857377 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.857231    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 23:06:59.868831 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.868809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:59.868993 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.868967    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:59.906987 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.906951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:06:59.907160 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.907028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv5nq\" (UniqueName: \"kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:06:59.917517 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.917452    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 23:06:59.929108 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.929078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:06:59.943286 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.943262    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tw7s4\""
Oct 30 23:06:59.952389 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.952321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:06:59.952554 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.952531    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-trr47\""
Oct 30 23:06:59.962063 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.962041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:06:59.963320 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.963299    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dcddbd87f-zwc2x"]
Oct 30 23:06:59.966556 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:06:59.966537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.007970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5nq\" (UniqueName: \"kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.008988 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.008316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4hk\" (UniqueName: \"kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.015276 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.015247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.025814    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.025912    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cff4m9cl3lci8\""
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.025997    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.026085    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5sdcn\""
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.026145    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 23:07:00.026207 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.026176    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 23:07:00.027257 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.027186    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcddbd87f-zwc2x"]
Oct 30 23:07:00.067656 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.066842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5nq\" (UniqueName: \"kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:00.099337 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.099249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:00.109681 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.109787 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.109787 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.109902 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.109902 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4hk\" (UniqueName: \"kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.109902 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.110035 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.109907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.111365 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.110652    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.111365 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.111056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.111365 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.111311    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.112546 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.112514    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.113159 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.113136    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.114187 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.114169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.167810 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.167786    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4hk\" (UniqueName: \"kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.220327 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.220294    2576 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="68f5d6a5bc8adaaf98685eb00b943fb3022ac8f8a148370b08fbabcdfcc78e3c" exitCode=0
Oct 30 23:07:00.220815 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.220360    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"68f5d6a5bc8adaaf98685eb00b943fb3022ac8f8a148370b08fbabcdfcc78e3c"}
Oct 30 23:07:00.255583 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.255553    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fbzzd\""
Oct 30 23:07:00.264541 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.264521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:00.281325 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.281296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:00.326867 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.326794    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wk6h"]
Oct 30 23:07:00.333849 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:00.333821    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd46d589_b55e_4971_9abc_1595f7d4a900.slice/crio-85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685 WatchSource:0}: Error finding container 85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685: Status 404 returned error can't find the container with id 85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685
Oct 30 23:07:00.378720 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.378688    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mwnl"]
Oct 30 23:07:00.383980 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:00.383943    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767ef969_8394_4941_84fb_beda11cc4709.slice/crio-8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b WatchSource:0}: Error finding container 8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b: Status 404 returned error can't find the container with id 8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b
Oct 30 23:07:00.481329 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.481291    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"]
Oct 30 23:07:00.484421 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:00.484394    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fff5edd_ad77_4f60_8b68_007782672512.slice/crio-a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48 WatchSource:0}: Error finding container a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48: Status 404 returned error can't find the container with id a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48
Oct 30 23:07:00.637235 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.637140    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94xqm"]
Oct 30 23:07:00.640807 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:00.640779    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f2ae1d_bfae_48b3_869b_b779f230415a.slice/crio-acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870 WatchSource:0}: Error finding container acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870: Status 404 returned error can't find the container with id acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870
Oct 30 23:07:00.673992 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.673955    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcddbd87f-zwc2x"]
Oct 30 23:07:00.682005 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:00.681978    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25f7043_d8b2_4e7b_a8f7_7ebac76c86fe.slice/crio-0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7 WatchSource:0}: Error finding container 0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7: Status 404 returned error can't find the container with id 0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7
Oct 30 23:07:00.834141 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.834114    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bb769446-4pf69"]
Oct 30 23:07:00.838971 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.838951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.891901 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.891815    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.917523 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.917318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsst\" (UniqueName: \"kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.944394    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb769446-4pf69"]
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.945487    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.945590    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.945776    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.945870    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.945955    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 23:07:00.946140 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:00.946076    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hlqvv\""
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.019490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.018765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsst\" (UniqueName: \"kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.020015 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.019838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.020311 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.020242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.020741 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.020704    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.021490 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.021465    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.022084 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.022061    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.023189 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.023171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.023264 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.023172    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.076277 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.076246    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsst\" (UniqueName: \"kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.159388 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.159363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:01.232945 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.232914    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"20d5e3eaa5a86b71e54a57525e24cd773fd083c574d85cf1cc0d7867fac60f46"}
Oct 30 23:07:01.233324 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.233013    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"56d85960ea7bddf1f516fd925e0d850ebc817318c23c5a2138e8d18b09a424e7"}
Oct 30 23:07:01.234481 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.234450    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x" event={"ID":"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe","Type":"ContainerStarted","Data":"0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7"}
Oct 30 23:07:01.235704 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.235668    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94xqm" event={"ID":"e9f2ae1d-bfae-48b3-869b-b779f230415a","Type":"ContainerStarted","Data":"acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870"}
Oct 30 23:07:01.236952 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.236891    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mwnl" event={"ID":"767ef969-8394-4941-84fb-beda11cc4709","Type":"ContainerStarted","Data":"8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b"}
Oct 30 23:07:01.240525 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.240053    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wk6h" event={"ID":"fd46d589-b55e-4971-9abc-1595f7d4a900","Type":"ContainerStarted","Data":"85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685"}
Oct 30 23:07:01.242931 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.242907    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m" event={"ID":"1fff5edd-ad77-4f60-8b68-007782672512","Type":"ContainerStarted","Data":"a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48"}
Oct 30 23:07:01.633403 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:01.632233    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb769446-4pf69"]
Oct 30 23:07:01.639061 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:01.639004    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5961be49_a9c6_44f7_9c9a_ec04c0dc7226.slice/crio-2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f WatchSource:0}: Error finding container 2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f: Status 404 returned error can't find the container with id 2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f
Oct 30 23:07:02.250200 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.250094    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb769446-4pf69" event={"ID":"5961be49-a9c6-44f7-9c9a-ec04c0dc7226","Type":"ContainerStarted","Data":"2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f"}
Oct 30 23:07:02.255505 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.255474    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"5f6693ca7bf3da362e8bc998d869223ed0e1579ede5a92189ad447e89a385c10"}
Oct 30 23:07:02.372287 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.372256    2576 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:07:02.406852 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.406820    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-996d7c98d-jbv7s"]
Oct 30 23:07:02.410396 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.410378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.487270 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.487242    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-996d7c98d-jbv7s"]
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.539607 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.539395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.640458    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.641349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.641293    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.642198 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.642175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.642725 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.642704    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.642854 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.642831    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.644521 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.644494    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.650141 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.650113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.709760 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.709610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:02.726330 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:02.726089    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:03.133434 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.133400    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-996d7c98d-jbv7s"]
Oct 30 23:07:03.141801 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:03.141766    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd589edbb_387b_4a9f_8a8e_171a2fff06cf.slice/crio-bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851 WatchSource:0}: Error finding container bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851: Status 404 returned error can't find the container with id bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851
Oct 30 23:07:03.266041 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.265946    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-996d7c98d-jbv7s" event={"ID":"d589edbb-387b-4a9f-8a8e-171a2fff06cf","Type":"ContainerStarted","Data":"5108fd6fdb843e5c9649793812e40371837441ff21db3ad86cc13cd50416e0e2"}
Oct 30 23:07:03.267242 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.266678    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-996d7c98d-jbv7s" event={"ID":"d589edbb-387b-4a9f-8a8e-171a2fff06cf","Type":"ContainerStarted","Data":"bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851"}
Oct 30 23:07:03.274379 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.273034    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mwnl" event={"ID":"767ef969-8394-4941-84fb-beda11cc4709","Type":"ContainerStarted","Data":"f0fde9009340039cfb30433bb0244d93a7b2993641aabe8e4344748d0852b8f0"}
Oct 30 23:07:03.274379 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.273085    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mwnl" event={"ID":"767ef969-8394-4941-84fb-beda11cc4709","Type":"ContainerStarted","Data":"b96f8c7c6904b8ec886bcb7cae24b914c2c42280fdee50c13e8338b0d136c7ee"}
Oct 30 23:07:03.284480 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.284458    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"347c6fa832d83f68d2b07f297e0076d27ee5731608bc9711e3023b2bfa416126"}
Oct 30 23:07:03.508232 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:03.507947    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-996d7c98d-jbv7s" podStartSLOduration=1.507931663 podStartE2EDuration="1.507931663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:03.393034572 +0000 UTC m=+69.977498498" watchObservedRunningTime="2026-10-30 23:07:03.507931663 +0000 UTC m=+70.092395584"
Oct 30 23:07:04.261072 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.258206    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9mwnl" podStartSLOduration=68.374982984 podStartE2EDuration="1m10.258185477s" totalImagesPullingTime="1.883202493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:03.508189183 +0000 UTC m=+70.092653110" watchObservedRunningTime="2026-10-30 23:07:04.258185477 +0000 UTC m=+70.842649405"
Oct 30 23:07:04.261072 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.258774    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:04.264374 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.264352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.302040 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.301977    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m" event={"ID":"1fff5edd-ad77-4f60-8b68-007782672512","Type":"ContainerStarted","Data":"270aa75d1bd2a493bced8d130c56337a58a081325dd5f16889dfb10815811e24"}
Oct 30 23:07:04.304890 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.304861    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:04.311700 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.310343    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:04.313578 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.313531    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x" event={"ID":"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe","Type":"ContainerStarted","Data":"19ca01ae946afe511ff2cf19cfa0578538732e17d0c990bc1e329346aa23bb5d"}
Oct 30 23:07:04.319046 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.319028    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 23:07:04.320492 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320366    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 23:07:04.320492 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320374    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 23:07:04.320492 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320419    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 23:07:04.320492 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320432    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4u7qa66bq4aih\""
Oct 30 23:07:04.320492 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320446    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tfc2b\""
Oct 30 23:07:04.320783 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.320741    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 23:07:04.322228 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322205    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"1303bff929471c828179c139e23a376c3f1d2ff8a78250569faa885cbccd9a21"}
Oct 30 23:07:04.322349 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322330    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"62ba98867c965cd96339a723ebe36cd39cf2e5e6711ccd0345240ec41086ad07"}
Oct 30 23:07:04.322417 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322379    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"fa16225870e318639eb5fef9c12c0f361175432eaa3b734d2009ee5f8d5a71fc"}
Oct 30 23:07:04.322468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322423    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"5398a11b91c16189d0068217f0d3b5e2c124caecf4c1030e0cef716cb71fdd45"}
Oct 30 23:07:04.322468 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322463    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"c8d24116f5a165688bdc9e4d1ebe7340f98e3776b7f29d56c4620664eabd79ac"}
Oct 30 23:07:04.322582 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.322500    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerStarted","Data":"0c2e2e58cc583ca0df507927f2d78cbb79489f4335298bedf4096aa7177b62ff"}
Oct 30 23:07:04.323796 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.323777    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 23:07:04.323912 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.323891    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 23:07:04.324003 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.323984    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 23:07:04.324051 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.324017    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 23:07:04.324112 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.324098    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 23:07:04.324173 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.324119    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 23:07:04.329295 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.329273    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"8dbb89518a058141218d585e8cb25ee9a1e89d82a8b27c4b1c9aaaa26c38c6e4"}
Oct 30 23:07:04.329381 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.329339    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" event={"ID":"64763c7a-6a43-4764-9fc5-b1e16d1f6c80","Type":"ContainerStarted","Data":"7f78d77bdd227ad89185ca1fa9ab308366819a682e2c0412c24ecaab7a9f3796"}
Oct 30 23:07:04.330217 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.330198    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:04.366878 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.366841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367047 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.366890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367047 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.366918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367047 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.366992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367273 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.367740 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.367424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.375072 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.375026    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 23:07:04.379038 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.379010    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 23:07:04.421428 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.421318    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 23:07:04.429717 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.429683    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:04.436166 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.436105    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:04.468659 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468787 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468835 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468879 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468913 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468949 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.468982 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.468967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469169 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469294 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469330 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469372 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469443 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469559 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469610 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469664 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469708 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469780 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469880 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469938 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.469991 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.469941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.470086 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.470058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.470572 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.470545    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.474646 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.471159    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.474646 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.473936    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.475068 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.475049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.476681 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.476656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.476782 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.476716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.477770 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.477744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.479264 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.478554    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.479264 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.478651    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.479498 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.479474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.481075 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.481052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.481515 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.481332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.481515 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.481397    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.481515 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.481463    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.481681 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.481664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.482711 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.482547    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.483789 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.483771    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.484000 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.483983    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.535896 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.535860    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.551672 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.551596    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x" podStartSLOduration=2.097256633 podStartE2EDuration="5.551579872s" totalImagesPullingTime="3.454323239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:04.549673485 +0000 UTC m=+71.134137415" watchObservedRunningTime="2026-10-30 23:07:04.551579872 +0000 UTC m=+71.136043800"
Oct 30 23:07:04.619355 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.619295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:04.674698 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.673792    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q" podStartSLOduration=3.153876827 podStartE2EDuration="7.673761053s" totalImagesPullingTime="4.519884226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:04.670562843 +0000 UTC m=+71.255026770" watchObservedRunningTime="2026-10-30 23:07:04.673761053 +0000 UTC m=+71.258224981"
Oct 30 23:07:04.802435 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.802373    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.239015372 podStartE2EDuration="7.802349099s" totalImagesPullingTime="4.549932833s" totalInitContainerRuntime="13.400894ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:04.798970054 +0000 UTC m=+71.383433990" watchObservedRunningTime="2026-10-30 23:07:04.802349099 +0000 UTC m=+71.386813033"
Oct 30 23:07:04.916637 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:04.916560    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m" podStartSLOduration=2.474665887 podStartE2EDuration="5.916536015s" totalImagesPullingTime="3.441870128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:04.913680903 +0000 UTC m=+71.498144832" watchObservedRunningTime="2026-10-30 23:07:04.916536015 +0000 UTC m=+71.500999944"
Oct 30 23:07:05.108569 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:05.108533    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:05.112574 ip-10-0-133-110 kubenswrapper[2576]: W1030 23:07:05.112540    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57fb91a_da7c_45fb_b508_c104c4e623ab.slice/crio-4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78 WatchSource:0}: Error finding container 4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78: Status 404 returned error can't find the container with id 4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78
Oct 30 23:07:05.348826 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:05.341912    2576 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d" exitCode=0
Oct 30 23:07:05.348826 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:05.342007    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d"}
Oct 30 23:07:05.348826 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:05.342111    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78"}
Oct 30 23:07:05.348826 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:05.344545    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb769446-4pf69" event={"ID":"5961be49-a9c6-44f7-9c9a-ec04c0dc7226","Type":"ContainerStarted","Data":"cc0ea52efbb996637142604ac4f59b53e8582a7faa3544bc002f16f8225ecfd1"}
Oct 30 23:07:06.353021 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:06.352991    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb769446-4pf69" event={"ID":"5961be49-a9c6-44f7-9c9a-ec04c0dc7226","Type":"ContainerStarted","Data":"7778cdcd4c42ab6df85bf7603f6256f727fb8c0192de48d2fe094cfa262715d6"}
Oct 30 23:07:06.353384 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:06.353061    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb769446-4pf69" event={"ID":"5961be49-a9c6-44f7-9c9a-ec04c0dc7226","Type":"ContainerStarted","Data":"bcb47f562a6eb736d5a631176190fec0185e7795545f3c943c30fe45ddaac986"}
Oct 30 23:07:06.474841 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:06.474785    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bb769446-4pf69" podStartSLOduration=2.926020732 podStartE2EDuration="6.474768005s" totalImagesPullingTime="3.548747273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:06.47308029 +0000 UTC m=+73.057544216" watchObservedRunningTime="2026-10-30 23:07:06.474768005 +0000 UTC m=+73.059231932"
Oct 30 23:07:07.360733 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:07.360690    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94xqm" event={"ID":"e9f2ae1d-bfae-48b3-869b-b779f230415a","Type":"ContainerStarted","Data":"61a5d49b0e9eb17cd92f2013cfe23d17ce04773ba6ff1bd331107c89860a8518"}
Oct 30 23:07:07.361222 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:07.360792    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:07.491240 ip-10-0-133-110 kubenswrapper[2576]: I1030 23:07:07.491179    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94xqm" podStartSLOduration=67.844646313 podStartE2EDuration="1m13.491159847s" totalImagesPullingTime="5.646513534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:07.487574372 +0000 UTC m=+74.072038299" watchObservedRunningTime="2026-10-30 23:07:07.491159847 +0000 UTC m=+74.075623776"
Oct 30 23:07:08.154072 ip-10-0-133-110 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 23:07:08.168088 ip-10-0-133-110 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 23:07:08.168309 ip-10-0-133-110 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 23:07:08.168370 ip-10-0-133-110 systemd[1]: kubelet.service: Consumed 4.795s CPU time.
Oct 30 23:07:08.187287 ip-10-0-133-110 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 23:07:08.279474 ip-10-0-133-110 kubenswrapper[6126]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:07:08.279474 ip-10-0-133-110 kubenswrapper[6126]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 23:07:08.279474 ip-10-0-133-110 kubenswrapper[6126]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:07:08.279474 ip-10-0-133-110 kubenswrapper[6126]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:07:08.281964 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281867    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.281964 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281960    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.281964 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281965    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.281964 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281968    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.281964 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281971    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281975    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281979    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281982    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281985    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281988    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281991    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281994    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281996    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.281999    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282002    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282004    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282007    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282009    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282012    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282015    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282019    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282023    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282028    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282033    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.282221 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282037    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282041    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282044    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282053    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282056    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282059    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282062    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282065    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282069    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282073    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282077    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282082    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282087    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282091    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282096    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282101    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282105    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282110    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282114    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282119    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.282889 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282123    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282127    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282132    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282138    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282143    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282148    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282152    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282157    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282161    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282167    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282171    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282176    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282180    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282185    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282190    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282194    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282198    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282203    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282208    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282212    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.283473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282217    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282220    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282222    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282225    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282228    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282231    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282235    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282238    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282241    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282243    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282246    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282249    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282251    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282254    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282257    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282260    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282263    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282266    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282269    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.284097 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282272    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282275    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282277    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282282    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282287    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282292    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282295    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282298    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282301    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282305    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282309    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282312    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282315    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282318    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282321    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282325    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282330    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282334    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282338    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.284656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282343    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282347    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282351    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.282357    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283284    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283298    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283303    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283309    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283314    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283321    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283326    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283329    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283332    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283337    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283342    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283345    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283349    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283352    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283355    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.285213 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283358    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283360    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283363    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283366    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283369    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283371    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283374    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283376    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283379    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283382    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283384    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283387    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283390    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283392    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283395    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283398    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283401    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283404    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283406    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283409    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.285764 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283412    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283415    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283417    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283420    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283423    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283426    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283429    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283431    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283434    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283436    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283439    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283442    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283445    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283448    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283450    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283456    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283458    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283461    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283464    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283467    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.286371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283470    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283473    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283476    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283479    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283482    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283485    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283488    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283490    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283493    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283496    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283499    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283501    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283507    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283512    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283516    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283520    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283525    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283529    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283532    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.286980 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283535    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283537    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283540    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283543    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283546    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283549    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283552    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283555    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283563    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283567    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283569    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283572    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283576    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283580    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283586    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283591    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283594    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283596    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283599    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.287604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283602    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283606    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283608    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283626    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283629    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283632    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283635    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283637    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283640    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283643    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283645    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283648    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.283651    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284289    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284297    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284300    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284303    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284306    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284310    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284313    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.288169 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284315    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284319    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284321    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284324    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284327    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284330    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284332    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284335    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284338    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284340    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284343    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284345    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284349    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284351    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284354    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284357    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284360    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284363    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284366    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.288787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284369    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284371    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284374    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284378    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284381    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284384    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284387    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284389    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284393    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284395    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284398    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284401    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284404    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284407    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284414    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284417    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284419    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284422    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284425    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284428    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.289284 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284430    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284434    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284436    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284439    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284441    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284444    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284447    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284449    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284452    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284455    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284458    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284462    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284466    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284470    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284475    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284480    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284484    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284489    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284493    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284498    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.289891 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284502    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284506    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284511    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284516    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284520    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284525    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284531    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284535    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284539    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284544    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284548    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284552    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284555    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284558    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284562    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284567    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284571    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284575    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284580    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.290442 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284584    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284587    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284589    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284592    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284595    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284599    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284603    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284610    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284632    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284639    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284645    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284649    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284652    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284655    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284658    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284663    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284666    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284669    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284671    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.291241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284677    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.284679    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284806    6126 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284817    6126 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284826    6126 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284833    6126 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284837    6126 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284841    6126 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284845    6126 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284850    6126 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284853    6126 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284856    6126 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284862    6126 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284866    6126 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284869    6126 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284873    6126 flags.go:64] FLAG: --cgroup-root=""
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284876    6126 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284879    6126 flags.go:64] FLAG: --client-ca-file=""
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284882    6126 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284885    6126 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284890    6126 flags.go:64] FLAG: --cluster-domain=""
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284895    6126 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284901    6126 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284906    6126 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 23:07:08.292068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284912    6126 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284917    6126 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284920    6126 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284923    6126 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284927    6126 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284930    6126 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284933    6126 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284936    6126 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284941    6126 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284945    6126 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284949    6126 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284952    6126 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284955    6126 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284958    6126 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284961    6126 flags.go:64] FLAG: --enable-server="true"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284964    6126 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284969    6126 flags.go:64] FLAG: --event-burst="100"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284973    6126 flags.go:64] FLAG: --event-qps="50"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284978    6126 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284984    6126 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284991    6126 flags.go:64] FLAG: --eviction-hard=""
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284996    6126 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.284999    6126 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285004    6126 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285008    6126 flags.go:64] FLAG: --eviction-soft=""
Oct 30 23:07:08.293062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285013    6126 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285018    6126 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285023    6126 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285028    6126 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285033    6126 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285039    6126 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285044    6126 flags.go:64] FLAG: --feature-gates=""
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285051    6126 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285056    6126 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285061    6126 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285065    6126 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285070    6126 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285075    6126 flags.go:64] FLAG: --help="false"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285080    6126 flags.go:64] FLAG: --hostname-override="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285086    6126 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285092    6126 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285097    6126 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285102    6126 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285106    6126 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285109    6126 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285113    6126 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285116    6126 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285118    6126 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 23:07:08.293830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285122    6126 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285125    6126 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285128    6126 flags.go:64] FLAG: --kube-reserved=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285131    6126 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285135    6126 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285138    6126 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285142    6126 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285147    6126 flags.go:64] FLAG: --lock-file=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285152    6126 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285157    6126 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285162    6126 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285168    6126 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285171    6126 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285175    6126 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285178    6126 flags.go:64] FLAG: --logging-format="text"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285181    6126 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285184    6126 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285187    6126 flags.go:64] FLAG: --manifest-url=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285190    6126 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285195    6126 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285198    6126 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285202    6126 flags.go:64] FLAG: --max-pods="110"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285213    6126 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285217    6126 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285222    6126 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 23:07:08.294508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285227    6126 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285233    6126 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285238    6126 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285244    6126 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285252    6126 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285256    6126 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285259    6126 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285263    6126 flags.go:64] FLAG: --pod-cidr=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285268    6126 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285272    6126 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285277    6126 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285284    6126 flags.go:64] FLAG: --port="10250"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285289    6126 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285293    6126 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-01271fa1ed2a041e3"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285298    6126 flags.go:64] FLAG: --qos-reserved=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285303    6126 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285308    6126 flags.go:64] FLAG: --register-node="true"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285312    6126 flags.go:64] FLAG: --register-with-taints=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285318    6126 flags.go:64] FLAG: --registry-burst="10"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285322    6126 flags.go:64] FLAG: --registry-qps="5"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285325    6126 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285328    6126 flags.go:64] FLAG: --reserved-memory=""
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285332    6126 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285336    6126 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285339    6126 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285341    6126 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 23:07:08.295467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285344    6126 flags.go:64] FLAG: --runonce="false"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285348    6126 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285351    6126 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285354    6126 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285357    6126 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285361    6126 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285364    6126 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285367    6126 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285370    6126 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285378    6126 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285381    6126 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285384    6126 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285387    6126 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285390    6126 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285393    6126 flags.go:64] FLAG: --system-cgroups=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285396    6126 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285401    6126 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285405    6126 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285408    6126 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285413    6126 flags.go:64] FLAG: --tls-min-version=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285416    6126 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285419    6126 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285422    6126 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285425    6126 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285428    6126 flags.go:64] FLAG: --v="2"
Oct 30 23:07:08.296295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285432    6126 flags.go:64] FLAG: --version="false"
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285437    6126 flags.go:64] FLAG: --vmodule=""
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285441    6126 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285444    6126 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285610    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285628    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285631    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285633    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285636    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285639    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285642    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285644    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285647    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285651    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285654    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285657    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285659    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285663    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285665    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285668    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.297018 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285671    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285674    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285677    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285680    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285684    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285687    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285689    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285692    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285695    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285698    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285701    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285703    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285706    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285708    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285711    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285714    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285716    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285719    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285722    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285724    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.297840 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285727    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285731    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285735    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285739    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285743    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285748    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285752    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285756    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285760    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285764    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285768    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285773    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285777    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285781    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285786    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285789    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285793    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285798    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285801    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.298482 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285805    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285807    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285810    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285813    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285815    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285818    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285820    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285823    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285826    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285828    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285831    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285833    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285836    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285838    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285841    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285843    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285846    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285848    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285851    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.299080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285853    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285856    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285858    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285861    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285863    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285866    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285871    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285876    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285879    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285882    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285887    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285891    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285893    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285896    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285899    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285902    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285905    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285908    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285910    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.299654 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285913    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285916    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285918    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285921    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285924    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285926    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285929    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285932    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285935    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285939    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285944    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285948    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.285952    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.285991    6126 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286029    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286034    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.300380 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286037    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286039    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286042    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286045    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286048    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286053    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286057    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286063    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286066    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286069    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286072    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286075    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286078    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286081    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286083    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286086    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286089    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286092    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286094    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.300994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286097    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286100    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286102    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286105    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286108    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286111    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286114    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286116    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286119    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286121    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286124    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286126    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286129    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286132    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286135    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286139    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286142    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286147    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286154    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.301819 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286159    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286164    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286168    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286172    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286177    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286181    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286185    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286189    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286193    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286197    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286200    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286202    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286205    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286207    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286210    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286213    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286216    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286219    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286221    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286224    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.302364 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286226    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286229    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286231    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286234    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286237    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286239    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286242    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286245    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286247    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286250    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286252    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286258    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286260    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286264    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286267    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286269    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286272    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286275    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286277    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286280    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.302999 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286283    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286285    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286288    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286291    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286293    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286296    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286299    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286301    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286304    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286306    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286309    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286312    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286314    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286317    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286319    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286322    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286325    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286327    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286330    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286332    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.303689 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286335    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286337    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286341    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286345    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286348    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.286352    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.293101    6126 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.293122    6126 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.293150    6126 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.293157    6126 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293253    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293261    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293266    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293271    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293276    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293280    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293285    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293289    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293294    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293298    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.304415 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293302    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293307    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293311    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293315    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293320    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293324    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293329    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293333    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293337    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293341    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293345    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293350    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293354    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293358    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293362    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293366    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293370    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293374    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293379    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293383    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.305200 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293388    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293392    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293396    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293400    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293404    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293409    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293413    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293417    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293421    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293426    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293430    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293435    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293440    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293447    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293455    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293460    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293466    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293471    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293476    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.305885 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293480    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293484    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293488    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293492    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293497    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293501    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293505    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293509    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293514    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293518    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293522    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293527    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293531    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293537    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293543    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293548    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293552    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293557    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293561    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293565    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.306501 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293569    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293573    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293578    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293582    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293587    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293591    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293595    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293599    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293603    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293607    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293629    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293634    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293638    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293642    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293646    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293650    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293654    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293659    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293663    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.307222 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293669    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293673    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293677    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293681    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293685    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293689    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293693    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293697    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293701    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293705    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293709    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293714    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293718    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293722    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293726    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293730    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293734    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.307822 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.293738    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.293778    6126 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294031    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294039    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294045    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294051    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294057    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294065    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294070    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294074    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294078    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294083    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294087    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294091    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294096    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294100    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.308320 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294104    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294109    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294113    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294117    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294121    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294125    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294129    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294133    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294138    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294142    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294147    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294151    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294155    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294160    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294164    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294169    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294173    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294177    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294181    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294185    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.308842 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294190    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294194    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294198    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294203    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294207    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294212    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294216    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294220    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294224    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294228    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294232    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294236    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294240    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294245    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294249    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294253    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294258    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294262    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294266    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294270    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.309718 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294274    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294279    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294283    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294287    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294292    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294296    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294300    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294304    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294309    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294313    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294317    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294321    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294325    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294329    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294333    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294337    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294341    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294346    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294353    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.310508 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294359    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294365    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294370    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294376    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294381    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294385    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294389    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294394    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294399    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294403    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294408    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294412    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294416    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294420    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294425    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294429    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294433    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294438    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294442    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294446    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.311182 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294450    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294455    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294459    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294463    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294467    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294472    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294476    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294480    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294484    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294488    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294494    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294501    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294505    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.294541    6126 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294594    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294600    6126 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:07:08.311903 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294609    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294630    6126 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294635    6126 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294640    6126 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294646    6126 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294652    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294657    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294661    6126 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294666    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294670    6126 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294675    6126 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294679    6126 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294684    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294688    6126 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294692    6126 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294696    6126 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294700    6126 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294704    6126 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294708    6126 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:07:08.312418 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294712    6126 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294716    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294721    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294725    6126 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294729    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294733    6126 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294737    6126 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294741    6126 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294745    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294751    6126 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294757    6126 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294761    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294766    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294772    6126 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294776    6126 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294780    6126 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294784    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294789    6126 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294793    6126 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294797    6126 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:07:08.313089 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294801    6126 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294805    6126 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294809    6126 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294813    6126 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294817    6126 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294822    6126 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294826    6126 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294830    6126 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294834    6126 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294838    6126 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294842    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294846    6126 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294850    6126 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294854    6126 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294858    6126 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294864    6126 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294868    6126 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294872    6126 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294876    6126 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294880    6126 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:07:08.313777 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294884    6126 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294888    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294893    6126 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294897    6126 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294901    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294907    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294913    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294917    6126 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294921    6126 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294926    6126 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294930    6126 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294935    6126 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294939    6126 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294943    6126 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294947    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294951    6126 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294955    6126 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294960    6126 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294964    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:07:08.314473 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294968    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294975    6126 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294981    6126 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294985    6126 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294990    6126 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294994    6126 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.294998    6126 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295003    6126 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295009    6126 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295013    6126 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295017    6126 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295021    6126 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295025    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295030    6126 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295034    6126 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295038    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295045    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295050    6126 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295055    6126 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:07:08.315063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295060    6126 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295064    6126 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295068    6126 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295073    6126 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295077    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295082    6126 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:08.295086    6126 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.295173    6126 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.296789    6126 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.296866    6126 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.297120    6126 server.go:1014] "Starting client certificate rotation"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.297277    6126 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.297335    6126 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:00:54 +0000 UTC" deadline="2028-04-26 11:52:20.113798077 +0000 UTC"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.297402    6126 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13044h45m11.816400288s"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.297868    6126 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.299533    6126 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:07:08.315672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.300929    6126 log.go:25] "Validated CRI v1 runtime API"
Oct 30 23:07:08.316160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.303280    6126 log.go:25] "Validated CRI v1 image API"
Oct 30 23:07:08.316160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.304238    6126 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 23:07:08.316160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.307320    6126 fs.go:135] Filesystem UUIDs: map[52908d6c-5829-41ce-a412-e277f54a3ea0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7a39cd70-4f54-4cb9-8e78-087db231a77c:/dev/nvme0n1p3]
Oct 30 23:07:08.316269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.307346    6126 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7/userdata/shm major:0 minor:410 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f/userdata/shm major:0 minor:435 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4/userdata/shm major:0 minor:369 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78/userdata/shm major:0 minor:541 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01/userdata/shm major:0 minor:318 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685/userdata/shm major:0 minor:396 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b/userdata/shm major:0 minor:398 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914/userdata/shm major:0 minor:316 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48/userdata/shm major:0 minor:402 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7/userdata/shm major:0 minor:387 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870/userdata/shm major:0 minor:408 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851/userdata/shm major:0 minor:461 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969/userdata/shm major:0 minor:264 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9/userdata/shm major:0 minor:295 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2/userdata/shm major:0 minor:312 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~projected/kube-api-access-t6dg5:{mountpoint:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~projected/kube-api-access-t6dg5 major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~projected/kube-api-access-rcc4k:{mountpoint:/var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~projected/kube-api-access-rcc4k major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~projected/kube-api-access-kv5nq:{mountpoint:/var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~projected/kube-api-access-kv5nq major:0 minor:401 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:400 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~projected/kube-api-access-6gs59:{mountpoint:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~projected/kube-api-access-6gs59 major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~projected/kube-api-access-9xq4g:{mountpoint:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~projected/kube-api-access-9xq4g major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~projected/kube-api-access-hql9m:{mountpoint:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~projected/kube-api-access-hql9m major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/413fb1a4-8787-4838-89bb-2f08bc170795/volumes/kubernetes.io~projected/kube-api-access-ct66p:{mountpoint:/var/lib/kubelet/pods/413fb1a4-8787-4838-89bb-2f08bc170795/volumes/kubernetes.io~projected/kube-api-access-ct66p major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/tmp major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~projected/kube-api-access-mqlq7:{mountpoint:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~projected/kube-api-access-mqlq7 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~projected/kube-api-access-zzsst:{mountpoint:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~projected/kube-api-access-zzsst major:0 minor:426 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:425 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:424 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:423 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:422 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~projected/kube-api-access-7mcmg:{mountpoint:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~projected/kube-api-access-7mcmg major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~projected/kube-api-access-jdzsx:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~projected/kube-api-access-jdzsx major:0 minor:386 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:385 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:381 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:384 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:383 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~projected/kube-api-access-5hpbp:{mountpoint:/var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~projected/kube-api-access-5hpbp major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~projected/kube-api-access-2x75n:{mountpoint:/var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~projected/kube-api-access-2x75n major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~secret/metrics-certs major:0 minor:393 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/alertmanager/9 major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/config-reloader/6 major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~empty-dir/config-out major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/kube-api-access-87w4g:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/kube-api-access-87w4g major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/tls-assets major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/config-volume major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/web-config major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8effbcce-e26d-409a-8537-ee344af6f563/volumes/kubernetes.io~projected/kube-api-access-2gn2h:{mountpoint:/var/lib/kubelet/pods/8effbcce-e26d-409a-8537-ee344af6f563/volumes/kubernetes.io~projected/kube-api-access-2gn2h major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~projected/kube-api-access-kh4hk:{mountpoint:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~projected/kube-api-access-kh4hk major:0 minor:407 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:405 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:404 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~projected/kube-api-access-nc6lz:{mountpoint:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~projected/kube-api-access-nc6lz major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afdd3a1c-cea6-480a-b43f-adf808299dde/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/afdd3a1c-cea6-480a-b43f-adf808299dde/volumes/kubernetes.io~secret/tls-certificates major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b296a934-af68-4984-8c70-0561822d5f17/volumes/kubernetes.io~projected/kube-api-access-bqngl:{mountpoint:/var/lib/kubelet/pods/b296a934-af68-4984-8c70-0561822d5f17/volumes/kubernetes.io~projected/kube-api-access-bqngl major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~projected/kube-api-access-q9cz7:{mountpoint:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~projected/kube-api-access-q9cz7 major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd3bcdb3-39da-41d5-9ebf-59116a07baf9/volumes/kubernetes.io~projected/kube-api-access-vcw7l:{mountpoint:/var/lib/kubelet/pods/bd3bcdb3-39da-41d5-9ebf-59116a07baf9/volumes/kubernetes.io~projected/kube-api-access-vcw7l major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:531 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~empty-dir/config-out major:0 minor:534 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/kube-api-access-zvv6m:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/kube-api-access-zvv6m major:0 minor:540 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/tls-assets major:0 minor:539 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/config major:0 minor:535 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:537 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:538 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:536 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:530 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:533 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:532 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:525 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/web-config major:0 minor:531 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~projected/kube-api-access-xqh8l:{mountpoint:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~projected/kube-api-access-xqh8l major:0 minor:460 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~projected/kube-api-access-7sbn7:{mountpoint:/var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~projected/kube-api-access-7sbn7 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e729c6bb-7337-4107-9833-b75ca14a82ab/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/e729c6bb-7337-4107-9833-b75ca14a82ab/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9f2ae1d-bfae-48b3-869b-b779f230415a/volumes/kubernetes.io~projected/kube-api-access-mn2r4:{mountpoint:/var/lib/kubelet/pods/e9f2ae1d-bfae-48b3-869b-b779f230415a/volumes/kubernetes.io~projected/kube-api-access-mn2r4 major:0 minor:395 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eddd2b94-9f61-44bb-a171-ade17ebc3f2a/volumes/kubernetes.io~projected/kube-api-access-6c5b7:{mountpoint:/var/lib/kubelet/pods/eddd2b94-9f61-44bb-a171-ade17ebc3f2a/volumes/kubernetes.io~projected/kube-api-access-6c5b7 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f18d2b48-cfd3-4963-89e3-468f7a468c71/volumes/kubernetes.io~projected/kube-api-access-szs8p:{mountpoint:/var/lib/kubelet/pods/f18d2b48-cfd3-4963-89e3-468f7a468c71/volumes/kubernetes.io~projected/kube-api-access-szs8p major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd46d589-b55e-4971-9abc-1595f7d4a900/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/fd46d589-b55e-4971-9abc-1595f7d4a900/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:394 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/3200bd779fafcbe976a03e71232b3f0ef809ff3dc96d567483614658ce63da23/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/cf8912594a1794c2361c9fd2fb11e751a0bda74bb3199bc58e28e756c9d54854/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/d245a65ed2873ceaff88789faa6aa0996d76e32f4ab30f968b1ccb53a7a9391f/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4d714e1fe2ae88c938b0d1d6e049e37cec46f53a571e4b70757d195682ecac45/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7016f48a5409fb9cf35b212a22d5bdf0348648261015437d47c80858316cf6a8/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/88cf755632314713ab30fd1ee02a7e454f37cf623209cf8985a10fd303c4e5cb/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/bae71c584c76c17a607acce7d4030f982d1d04d9043510801ef3d98022f7e0c6/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/c6902314d930b83894cd6578a09b9091a6b9235b9483ebf98d0979aedfb438ff/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/b7534ac4c6567652781867488a8bd812b31944b2b966ae150a2a2b2b0fe70d42/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/2b528b7facdc65c2926b1f9bf13b01b6703c9e56c4757050ed98aca19696ba0f/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/17666694a55e59a53aa0d01083f1feacb77d19163e91d43c1586f9e15422c55e/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/749b81e72445c0ffcd1720cc17f22048cd9f21c0e5c5f65f8455ba6e913a025f/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/eddd82993a357df5d20c2bb95f1838173a96e4c3ef41050fcec7a9e2fffca8dd/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/2349f33c0cf71e72f4d93396a0e7efd289d050f2ec317396a0b9bc6e77e6471b/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/763a201009dca93db858c3135293a4a9af5682f8f6cb91d7e4b22e1dbe0c6cb9/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/7f3dd6d6fd393b0b16fa4a8181cacfab30d80b26ffacf7577d5bb2a83cdab022/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/b15fc25991753c32773e6c1eecceb31771b1722ba8e2a7bb0393f6e644f32e56/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/e43335d3b2a85a6fb696864ace903283fb34e94cdf8f6c58666bd04d3a80363b/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/d0c75e8235107f0ebbb213c9f426ef3d713fd8b2b0c1906ab7815c39adf4f18b/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/7224caeef41088dd1657db228f996fb4604c27f6e54d14e172f4e6bbab2308ce/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/31c0b785a130020d66cfa5e2781323d18c2f3001e25ec9376ae7bc8d732266f0/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/416e591a80530b821d03f365e1be77647c7a8bcbc8345104a315ad3fae727e99/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/aafd2b6b0dd584a4f40cf976fdd834ef8c42ad520dc5df5530f64c78f2c60d82/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/7501b86897eedf10d8586dfeab5d3160e75e5f9ef7b8329f0ca82b42f2de170e/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/cb153985362201f073108ccde8b1e3c2f5b71b03cf9a6db07ac6692c8b5d21e3/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/2b198d7ae9e4bdcb56afb822f446b860335a5bcc5c06fc3cc038d7cf9779b3e3/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/43247ec189d8b9175f03cc78ea8afedc591f5c3bf9120d9f6c38d570d2e4d7e9/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/50104e97505ec89d5a1edf87f2e6889e5e4771e7987d17942e461bba0f8ba8d5/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/6b8c5023d20e1770109e57523e4ba46b436238945adb5c082c2811584c80c604/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/f12de8a1a5541b1e2ca740a13e158661d05c76d8185ab601d50597a146470fdb/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/d76ec6a25d378ea311a414713131833a72db29accd07a524c2dd3bfff146ebfb/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/00dd76bc16d28b7af9e6a4ff1bd9df9ff57506f904d49e2d0fbb00b2e1a749de/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/2aaaec2990d815bea23b5c836dbb5ff1dba61d8221c90d3992c5f440ad6fe1ef/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/6a8d68a64215ba7dc36ae1392a277c95c3e4f806fb3a5d58552c2599fa9cfeef/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/f35994780e49d187eb7a04307dded70f1765f7e2dd59081559fd3d8495cda66f/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/5a1ad2e9b843bd014844caf24c2ce7446d822cf46864df5594483c62cf17460f/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/f6e3e45f208e5ebdda82540579dae59d61fa6c8b373c867e13603464fd4d09a5/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/3a7064da034736c66066601749cd84279fbea854e7352c506a64a81b467ee544/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/0ee3d236d9e575fd3eb320a24a426482d8fba0f73413e032a6dc6d959b12dcc9/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/50c27f22427cf1d4c0c892f070e6906df0dc55fca7d9d6e38bf40fa3d4b8bf2e/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/4ce8c59f3398085efc5af4bb39b0acd74696649833b2a9f76153c98ec7355d3a/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/b4f9e7d43281b80317ee3cb5ca9d5813818c98b767869e2bce00552cd8d280c4/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/5b986bf61db34d90d8cd9a67a5eb8594449018015fa7e39efda476b5c422a7c7/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/2e3da8b1d4a42fa7b4bcb423df0e07d224a5261a89eabcfe988211988b057304/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/cc47a48f1a76b28a52439436ebe89364ab199321a891f07010a10428ff353286/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/1d68aa26152067fa034862271c3895b619a40f2806c314ce06bcaacd5a5fd9d2/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/ecabafd8dc245aabee157346538ddd307aef75d9bf1ce3f4640a79cadea89116/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/2b817d5e648445983f8b910d62cb92d7c5f20a89182a802a0486fc061045d928/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/9ee85bea5ec0e2aae2060970b2b147f33415986de5c3dd03413bd15659b239f5/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/f69a0512d81f80501d0dbc8aea4abec2665bf802152c4e229b2e21998a8b0364/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/bf3bb0859a142fa570efad613044e38d09b1eab1a3e6c09c6f979909ba44f1c1/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/584d1dcb6e643ddba838bc7217e86b0093e7f9142b52df58c53b8a409873eb66/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-412:{mountpoint:/var/lib/containers/storage/overlay/4208809c139d4bbd535383402428a7aaf34cc809243ccf536044c281d8f94b70/merged major:0 minor:412 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/b2690b5bdf3b6b47733ea7608a743796e91f8762bb3dd1d450bf8b4b3024c4eb/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/9f50bdfaa1e4b08bdfada48a108538bb5eecf295f55c956cee0e2947fc5e1c23/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/1142850d554e80cae9cca57044f963ef9df6ccccaa058f1850f9060d274b617f/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-420:{mountpoint:/var/lib/containers/storage/overlay/17e6292537b406225b5ad8dc4b11c094b1ee5522b5688b677a50bd937de6be8b/merged major:0 minor:420 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/3afd0b03951c05785c62c76781d5cba4d1507b6d01cb123dd0c9e3ab93d4ef17/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/312fd7e06cf85c002775909f7483e0176f5f83ea6ee771b05362c4274c54c820/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/b53c21db5588a144cb5707395a3ca25b1ba4637c1a770564fc4b3f58014159f7/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-442:{mountpoint:/var/lib/containers/storage/overlay/1f32776d6cd100dd7e198aa2ecfa53f3b8028ae2d50691959d7ed6e692d68a0e/merged major:0 minor:442 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/a40ce2cfe6ccb2fdfb5ed1d0a0c978b46c2ed175f940b1f0d016081ba89bf463/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/d9a4099ac78477d27ef2c377dc4703f4e999e01651d299dd7654c7b73c265615/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-463:{mountpoint:/var/lib/containers/storage/overlay/3eb74ff791c58465215d7ce503695709a090b4648008b5e0362bfaabb6f2f4cb/merged major:0 minor:463 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/784204eee380d99de03768c78eaf6880f5ba0165a0d3c858c1131f3c51688839/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-468:{mountpoint:/var/lib/containers/storage/overlay/7c4fe928c805236227f4ce14b9d7e81625d4f4f8a7ad9cff68d42c9124344325/merged major:0 minor:468 fsType:overlay blockSize:0} overlay_0-473:{mountpoint:/var/lib/containers/storage/overlay/27e9da4647df61c863109b097c69d98e21b6fbea65acb04baa557bc48776bf82/merged major:0 minor:473 fsType:overlay blockSize:0} overlay_0-477:{mountpoint:/var/lib/containers/storage/overlay/1d4c4ea96c6a691bbaa69b2c9e8ecad8aac7580439445198064d4b75d9b97e39/merged major:0 minor:477 fsType:overlay blockSize:0} overlay_0-484:{mountpoint:/var/lib/containers/storage/overlay/19cb6cfe4e7f4015b50b75c578fb892278662c23544cb2acd65a7a87d67d98d6/merged major:0 minor:484 fsType:overlay blockSize:0} overlay_0-489:{mountpoint:/var/lib/containers/storage/overlay/008913a4e669afa923aa6a3fcae6631649a694e36072c5936807ea72dd4c88e0/merged major:0 minor:489 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/3de4144deaad7e7cf1bf784164089f465edb298896aef92c102b74085b396e03/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-494:{mountpoint:/var/lib/containers/storage/overlay/2abbb6fde328b70e8b7a24d36c8794324c6ab758fcf13a7bccff4ba0fc387a5e/merged major:0 minor:494 fsType:overlay blockSize:0} overlay_0-499:{mountpoint:/var/lib/containers/storage/overlay/d6150202100e6290752cf06f11e0b0e1de817a1d646ccdc5f981ae3632a5d78d/merged major:0 minor:499 fsType:overlay blockSize:0} overlay_0-504:{mountpoint:/var/lib/containers/storage/overlay/a207b79cd1559eecff7ac7b52e269a804af7c3fa43fedc56130f20b6eaeba217/merged major:0 minor:504 fsType:overlay blockSize:0} overlay_0-509:{mountpoint:/var/lib/containers/storage/overlay/6f9ffbc8ed4a0a8ad5e9125076b40db632defa5f27594ba9f6632cfedfaed0d7/merged major:0 minor:509 fsType:overlay blockSize:0} overlay_0-514:{mountpoint:/var/lib/containers/storage/overlay/879f19ad667be5f4610c900a3eac504acc769e4c112f88361699bedf72f275ab/merged major:0 minor:514 fsType:overlay blockSize:0} overlay_0-516:{mountpoint:/var/lib/containers/storage/overlay/88677591670c4d571e1cd9bc48323b6c1b1dbbc05c05952ec20ad85335528d2c/merged major:0 minor:516 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/fad69dafff2602b46647ef36e0f8a193ae7b62d95ef5fa86067d7aca337b4e89/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-543:{mountpoint:/var/lib/containers/storage/overlay/8224f55a47b42f7804222505d855e8b28e60d046e3bd6168eff8cb372a9b41c2/merged major:0 minor:543 fsType:overlay blockSize:0} overlay_0-547:{mountpoint:/var/lib/containers/storage/overlay/2102da9282bc31d5878ba2f74f2d68a376d14e2c3b9e6212b69a0557c082bf0c/merged major:0 minor:547 fsType:overlay blockSize:0} overlay_0-551:{mountpoint:/var/lib/containers/storag
Oct 30 23:07:08.316732 ip-10-0-133-110 kubenswrapper[6126]: e/overlay/225d18b635cd895359e7d066eb297d48c71f02d082ad4ad13802d11f4024a42e/merged major:0 minor:551 fsType:overlay blockSize:0} overlay_0-552:{mountpoint:/var/lib/containers/storage/overlay/99698bc3418761398640fc1f428ccef916599a27546a5f3096163b7bca1ece00/merged major:0 minor:552 fsType:overlay blockSize:0} overlay_0-558:{mountpoint:/var/lib/containers/storage/overlay/fca89ddd92c99250e8591f7a2d06dc2d788b39d2e26cbe80e4e8250f827bb376/merged major:0 minor:558 fsType:overlay blockSize:0} overlay_0-563:{mountpoint:/var/lib/containers/storage/overlay/411c73caad1c634d07cc0744b00d6dc5497e2f052670f0c19d7d4589effced63/merged major:0 minor:563 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/c99842e50fbbce86894d1dde544f41f912f187acaf290d275a120a9f05e4c6a3/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/44308a325a3edd3ee35a06d8f5dddfcbfc499a017037fdb245a3545dfc91eb6c/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/3136f192227a13d9dd5c60d5369accb287b518bd6756c3f067c6d51389297b37/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/44e5df01c7cf441d5d64f29c048fa520191bc68b5402a9a494eba89bed1d2e08/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/9c1fcfbea1d1ab9dda258f2247ee1af027685846999d08f0865bce7415c002a5/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/fb140fa9eae07c2c96ca0c63f977e90db44cfbc223d3011147c088436cde82be/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/6dc911fc16faded89646bffef94d22f7b07b96963ac865524aaaebc03fdfd4d5/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/c29231cc3987e9e9ea3da7b4eb8e4f9b4900609d68277fbd89c61d9d3f33238e/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 23:07:08.319424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.318643    6126 manager.go:217] Machine: {Timestamp:2026-10-30 23:07:08.317685645 +0000 UTC m=+0.077778206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099504 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d46295847694264aaec43fc42759a SystemUUID:ec2d4629-5847-6942-64aa-ec43fc42759a BootID:9885737a-6d77-456d-a58b-d994f46d49af Filesystems:[{Device:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:404 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-412 DeviceMajor:0 DeviceMinor:412 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:423 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:360 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f18d2b48-cfd3-4963-89e3-468f7a468c71/volumes/kubernetes.io~projected/kube-api-access-szs8p DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:308 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:349 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-552 DeviceMajor:0 DeviceMinor:552 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-551 DeviceMajor:0 DeviceMinor:551 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0a68234999901c1989b409e1d9b265253236d23b458b4e3e7c74b009fe7586ec/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:531 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:539 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~projected/kube-api-access-2x75n DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e729c6bb-7337-4107-9833-b75ca14a82ab/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:530 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-543 DeviceMajor:0 DeviceMinor:543 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~projected/kube-api-access-rcc4k DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:360 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/b296a934-af68-4984-8c70-0561822d5f17/volumes/kubernetes.io~projected/kube-api-access-bqngl DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/afdd3a1c-cea6-480a-b43f-adf808299dde/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:243 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969/userdata/shm DeviceMajor:0 DeviceMinor:264 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e9f2ae1d-bfae-48b3-869b-b779f230415a/volumes/kubernetes.io~projected/kube-api-access-mn2r4 DeviceMajor:0 DeviceMinor:395 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:400 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:405 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:424 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-463 DeviceMajor:0 DeviceMinor:463 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-484 DeviceMajor:0 DeviceMinor:484 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:310 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8effbcce-e26d-409a-8537-ee344af6f563/volumes/kubernetes.io~projected/kube-api-access-2gn2h DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:360 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~projected/kube-api-access-zzsst DeviceMajor:0 DeviceMinor:426 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-509 DeviceMajor:0 DeviceMinor:509 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-514 DeviceMajor:0 DeviceMinor:514 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:538 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd279c84424c6663529b90f932f53b7b232693cfe2347a4e81eeea7824ce38a5/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/24cc81f8c065dcd3483f595be3e2cb4d313f5f6cc5b5a434877ad3489b9e66aa/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:382 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:384 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/acbab69fe872bcb0a5ce70386c089889c6448dc59e3a9ac161f322b6043cb870/userdata/shm DeviceMajor:0 DeviceMinor:408 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/95b20ac59d683c3ef2e482310d12b006d30ef368b0fca87627302db23b73fe2a/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:354 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8a736acfe9e7b3555bd459d26ec35dd3e63576c00f6a8af05bbca72aef2b8e7/userdata/shm DeviceMajor:0 DeviceMinor:387 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-477 DeviceMajor:0 DeviceMinor:477 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:534 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:306 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:357 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/767ef969-8394-4941-84fb-beda11cc4709/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:393 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:406 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/volumes/kubernetes.io~projected/kube-api-access-kh4hk DeviceMajor:0 DeviceMinor:407 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6fdf7882111e37ba080bd47ee9b02efada92fe414276c236914c0feb7bde0068/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~projected/kube-api-access-t6dg5 DeviceMajor:0 DeviceMinor:294 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:356 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:354 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a137b00a4249ba52f353569e25c07d7f858043b3b15e02cd29aa3fb46fbf5ed/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/48c22a54e535a933a14a442e71ec364e3ce7c93a955ec95b6db5cfef5fe515a0/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4/userdata/shm DeviceMajor:0 DeviceMinor:369 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eddd2b94-9f61-44bb-a171-ade17ebc3f2a/volumes/kubernetes.io~projected/kube-api-access-6c5b7 DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:355 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-420 DeviceMajor:0 DeviceMinor:420 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/914714d21ac10c9c9426fc82c8a3294af46a29f6b8e8a2305bc9d3c990cbd914/userdata/shm DeviceMajor:0 DeviceMinor:316 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1fff5edd-ad77-4f60-8b68-007782672512/volumes/kubernetes.io~projected/kube-api-access-kv5nq DeviceMajor:0 DeviceMinor:401 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:532 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:533 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:536 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7fda5275790f7e320535fb39d690596d4475530f63d564d3c0f47d6cbc2b54b/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/22f4477c82d5af3ff77274ade1ece375a142efd943e3eb70fd802630f23d887e/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~projected/kube-api-access-7sbn7 DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:262 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8e524a89dafa525e8f55a2cccf4064736387993895e667e4891d5671e50a917b/userdata/shm DeviceMajor:0 DeviceMinor:398 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:269 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:422 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:360 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-499 DeviceMajor:0 DeviceMinor:499 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:535 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~projected/kube-api-access-jdzsx DeviceMajor:0 DeviceMinor:386 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~projected/kube-api-access-xqh8l DeviceMajor:0 DeviceMinor:460 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bd3bcdb3-39da-41d5-9ebf-59116a07baf9/volumes/kubernetes.io~projected/kube-api-access-vcw7l DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/49f381dd-faeb-4e5a-bf51-c0adfb0837e3/volumes/kubernetes.io~projected/kube-api-access-mqlq7 DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:381 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d7ca0cc3ecf74cf707564e82c0e32f6e4377c598a940b982a951a17163adcd7/userdata/shm DeviceMajor:0 DeviceMinor:410 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~projected/kube-api-access-hql9m DeviceMajor:0 DeviceMinor:263 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~projected/kube-api-access-87w4g DeviceMajor:0 DeviceMinor:361 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a0fbd674886cf2a0220128f15e3ace233e821a80e33a86b8a06440c2baa66f48/userdata/shm DeviceMajor:0 DeviceMinor:402 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5961be49-a9c6-44f7-9c9a-ec04c0dc7226/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:425 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-504 DeviceMajor:0 DeviceMinor:504 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:531 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~projected/kube-api-access-q9cz7 DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6991d07b63142c23373887d5a7b322e050e4f2872cc5783f18e002baea5bc91d/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/deb415ec-3e02-40b4-bee6-419ae59a6658/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6b78d601-a26c-4cd3-ac5c-eea7b658f07f/volumes/kubernetes.io~projected/kube-api-access-5hpbp DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:377 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~projected/kube-api-access-6gs59 DeviceMajor:0 DeviceMinor:315 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fd46d589-b55e-4971-9abc-1595f7d4a900/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:394 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-468 DeviceMajor:0 DeviceMinor:468 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-516 DeviceMajor:0 DeviceMinor:516 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:537 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f02514a-3fb9-4bce-adec-87f1e75304a7/volumes/kubernetes.io~projected/kube-api-access-7mcmg DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d358e3f0c73cfd2498ef996025f4d9db1b1c0ef24e2617cd68caee00c8eb556c/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:257 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:358 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2636aeb4886ef77e4843b7d4678f8ef4254515a66dce63356dcbe844804ddc4f/userdata/shm DeviceMajor:0 DeviceMinor:435 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-547 DeviceMajor:0 DeviceMinor:547 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:311 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-494 DeviceMajor:0 DeviceMinor:494 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~projected/kube-api-access-zvv6m DeviceMajor:0 DeviceMinor:540 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-558 DeviceMajor:0 DeviceMinor:558 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1fb29279-c313-451b-bec0-8564faf340ef/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:289 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:353 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/85f27e4990b6e6f4f2be9524eb4da64a29e0ddf3e5df5c086f91bfc6c4867685/userdata/shm DeviceMajor:0 DeviceMinor:396 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/201241b0-a25e-4c89-9d64-c33bde6637c1/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:309 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:383 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:455 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851/userdata/shm DeviceMajor:0 DeviceMinor:461 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78/userdata/shm DeviceMajor:0 DeviceMinor:541 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-563 DeviceMajor:0 DeviceMinor:563 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:359 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-473 DeviceMajor:0 DeviceMinor:473 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:525 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/413fb1a4-8787-4838-89bb-2f08bc170795/volumes/kubernetes.io~projected/kube-api-access-ct66p DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/83e07476cbfc7fb5ee2b5204e682d83ebc80f7079d42142886a032440bfd6ccd/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~projected/kube-api-access-nc6lz DeviceMajor:0 DeviceMinor:307 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-442 DeviceMajor:0 DeviceMinor:442 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-489 DeviceMajor:0 DeviceMinor:489 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f3c8c785c22b173fc93449386a792f1bd63b888e78952e0585265aef91dc94a/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:268 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9/userdata/shm DeviceMajor:0 DeviceMinor:295 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64763c7a-6a43-4764-9fc5-b1e16d1f6c80/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:385 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:459 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/389f431d-8f1c-4f9c-8cac-e270a08b731a/volumes/kubernetes.io~projected/kube-api-access-9xq4g DeviceMajor:0 DeviceMinor:270 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:293 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/feb4e9b0f828a99b6d206cf4bb72e90cbd5e4aad681ad99b36d1fd363e220eb2/userdata/shm DeviceMajor:0 DeviceMinor:312 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6520ae2f3cd6893a242ba848d047ce6bce4085574fea440aec6fb7d9a32a0b01/userdata/shm DeviceMajor:0 DeviceMinor:318 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:301 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0a68234999901c1 MacAddress:d2:16:b9:0b:27:50 Speed:10000 Mtu:8901} {Name:0d7ca0cc3ecf74c MacAddress:02:ad:6d:67:45:dc Speed:10000 Mtu:8901} {Name:24cc81f8c065dcd MacAddress:82:c7:be:87:8a:c7 Speed:10000 Mtu:8901} {Name:2636aeb4886ef77 MacAddress:f2:b6:52:88:23:50 Speed:10000 Mtu:8901} {Name:4433294e38c4619 MacAddress:9e:73:ad:82:36:0f Speed:10000 Mtu:8901} {Name:48c22a54e535a93 MacAddress:46:d1:ff:57:5e:72 Speed:10000 Mtu:8901} {Name:4fb0e049d1b5cd3 MacAddress:36:d4:05:45:34:e6 Speed:10000 Mtu:8901} {Name:5f3c8c785c22b17 MacAddress:7a:33:35:ec:3f:f8 Speed:10000 Mtu:8901} {Name:6fdf7882111e37b MacAddress:06:6f:65:39:a4:12 Speed:10000 Mtu:8901} {Name:85f27e4990b6e6f MacAddress:ce:d9:46:d5:d8:b0 Speed:10000 Mtu:8901} {Name:8e524a89dafa525 MacAddress:4a:5c:ea:a7:12:d4 Speed:10000 Mtu:8901} {Name:914714d21ac10c9 MacAddress:aa:f8:68:40:0e:11 Speed:10000 Mtu:8901} {Name:a0fbd674886cf2a MacAddress:ea:7d:7c:c3:ec:21 Speed:10000 Mtu:8901} {Name:a8a736acfe9e7b3 MacAddress:ca:6f:76:12:21:e3 Speed:10000 Mtu:8901} {Name:acbab69fe872bcb MacAddress:42:b5:e2:7d:61:ce Speed:10000 Mtu:8901} {Name:bffa711ec0d8ab1 MacAddress:ce:11:f4:84:36:11 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:02:3e:40:34:13 Speed:0 Mtu:9001} {Name:br-int MacAddress:1a:f9:e2:98:f8:c5 Speed:0 Mtu:8901} {Name:d32f8421fbb25c1 MacAddress:b2:fb:df:d4:fe:65 Speed:10000 Mtu:8901} {Name:edb7b659a6ece7c MacAddress:22:33:88:f9:62:48 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:02:3e:40:34:13 Speed:0 Mtu:9001} {Name:feb4e9b0f828a99 MacAddress:b6:68:66:23:35:33 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:c2:aa:e4:f5:11:06 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:78:9a:b5:b8:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 23:07:08.319896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.319437    6126 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 23:07:08.319896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.319514    6126 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 23:07:08.319989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.319885    6126 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 23:07:08.320075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.319917    6126 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-110.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 23:07:08.320127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320078    6126 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 23:07:08.320127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320087    6126 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 23:07:08.320127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320098    6126 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:07:08.320127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320123    6126 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:07:08.320251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320233    6126 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 23:07:08.320426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320414    6126 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 23:07:08.320551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320541    6126 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 23:07:08.320593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320578    6126 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 23:07:08.320593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320589    6126 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 23:07:08.320673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320599    6126 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 23:07:08.320673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320609    6126 kubelet.go:405] "Adding apiserver pod source"
Oct 30 23:07:08.320673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.320630    6126 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 23:07:08.321517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.321500    6126 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 23:07:08.321517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.321517    6126 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:07:08.322084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.322066    6126 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 23:07:08.343489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.343466    6126 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 23:07:08.343489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.343488    6126 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:07:08.343724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.343640    6126 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 23:07:08.343948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.343926    6126 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 23:07:08.344035 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.343977    6126 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 23:07:08.344140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344125    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 23:07:08.344199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344156    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 23:07:08.344199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344169    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 23:07:08.344199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344182    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 23:07:08.344199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344192    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344201    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344210    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344221    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344231    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344240    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344254    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344269    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344307    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 23:07:08.344350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.344316    6126 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 23:07:08.350056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.348723    6126 server.go:1263] "Started kubelet"
Oct 30 23:07:08.349412 ip-10-0-133-110 systemd[1]: Started Kubernetes Kubelet.
Oct 30 23:07:08.350726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.350498    6126 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 23:07:08.351825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.351806    6126 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 23:07:08.352385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.352335    6126 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 23:07:08.352484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.352412    6126 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 23:07:08.353218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.353191    6126 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 23:07:08.354541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.354520    6126 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 23:07:08.355664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.354786    6126 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 23:07:08.355664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.355395    6126 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:00:56 +0000 UTC" deadline="2028-05-31 08:55:18.03689964 +0000 UTC"
Oct 30 23:07:08.355664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.355439    6126 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13881h48m9.6814661s"
Oct 30 23:07:08.355886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.355743    6126 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 23:07:08.355886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.355752    6126 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 23:07:08.355886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.355848    6126 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 23:07:08.357013 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.356106    6126 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:07:08.361638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.359969    6126 factory.go:55] Registering systemd factory
Oct 30 23:07:08.361638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.359998    6126 factory.go:223] Registration of the systemd container factory successfully
Oct 30 23:07:08.363449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363428    6126 factory.go:153] Registering CRI-O factory
Oct 30 23:07:08.363449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363445    6126 factory.go:223] Registration of the crio container factory successfully
Oct 30 23:07:08.363587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363516    6126 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 23:07:08.363587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363535    6126 factory.go:103] Registering Raw factory
Oct 30 23:07:08.363587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363546    6126 manager.go:1199] Started watching for new ooms in manager
Oct 30 23:07:08.363907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.363881    6126 manager.go:319] Starting recovery of all containers
Oct 30 23:07:08.376384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376338    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49f381dd-faeb-4e5a-bf51-c0adfb0837e3" volumeName="kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned" seLinuxMountContext=""
Oct 30 23:07:08.376553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376527    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 23:07:08.376553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376555    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="767ef969-8394-4941-84fb-beda11cc4709" volumeName="kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376579    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376592    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376608    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376660    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376673    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 23:07:08.376730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376712    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376741    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a50d5730-1bd4-4cea-8915-4a7d9ba6fc02" volumeName="kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376752    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376763    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376813    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376830    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376857    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376879    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 23:07:08.376926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376919    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376931    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd3bcdb3-39da-41d5-9ebf-59116a07baf9" volumeName="kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376952    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deb415ec-3e02-40b4-bee6-419ae59a6658" volumeName="kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376963    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9f2ae1d-bfae-48b3-869b-b779f230415a" volumeName="kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376973    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.376997    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b296a934-af68-4984-8c70-0561822d5f17" volumeName="kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377012    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377022    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377046    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fb29279-c313-451b-bec0-8564faf340ef" volumeName="kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377083    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f02514a-3fb9-4bce-adec-87f1e75304a7" volumeName="kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377095    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk" seLinuxMountContext=""
Oct 30 23:07:08.377130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377122    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 23:07:08.377610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377593    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 23:07:08.377610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377628    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fb29279-c313-451b-bec0-8564faf340ef" volumeName="kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377649    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377660    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49f381dd-faeb-4e5a-bf51-c0adfb0837e3" volumeName="kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377681    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377708    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377720    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="389f431d-8f1c-4f9c-8cac-e270a08b731a" volumeName="kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377731    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f02514a-3fb9-4bce-adec-87f1e75304a7" volumeName="kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377741    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 23:07:08.377754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377752    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377765    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377777    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fff5edd-ad77-4f60-8b68-007782672512" volumeName="kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377798    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377809    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377820    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd3bcdb3-39da-41d5-9ebf-59116a07baf9" volumeName="kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377832    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="389f431d-8f1c-4f9c-8cac-e270a08b731a" volumeName="kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377842    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377854    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377864    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f18d2b48-cfd3-4963-89e3-468f7a468c71" volumeName="kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377876    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f18d2b48-cfd3-4963-89e3-468f7a468c71" volumeName="kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377888    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377898    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377909    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377920    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdd3a1c-cea6-480a-b43f-adf808299dde" volumeName="kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377932    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377943    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377954    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="389f431d-8f1c-4f9c-8cac-e270a08b731a" volumeName="kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.377965    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378001    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378013    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378024    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8effbcce-e26d-409a-8537-ee344af6f563" volumeName="kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378034    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378046    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b296a934-af68-4984-8c70-0561822d5f17" volumeName="kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378056    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378066    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fb29279-c313-451b-bec0-8564faf340ef" volumeName="kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378078    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378090    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378100    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378110    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 23:07:08.378106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378121    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378132    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fb29279-c313-451b-bec0-8564faf340ef" volumeName="kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378144    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378156    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378168    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378181    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378193    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378204    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b78d601-a26c-4cd3-ac5c-eea7b658f07f" volumeName="kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378215    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="767ef969-8394-4941-84fb-beda11cc4709" volumeName="kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378226    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378237    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a50d5730-1bd4-4cea-8915-4a7d9ba6fc02" volumeName="kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378247    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f18d2b48-cfd3-4963-89e3-468f7a468c71" volumeName="kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378258    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378269    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8effbcce-e26d-409a-8537-ee344af6f563" volumeName="kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378280    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378291    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd46d589-b55e-4971-9abc-1595f7d4a900" volumeName="kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378302    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378316    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378326    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a50d5730-1bd4-4cea-8915-4a7d9ba6fc02" volumeName="kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378337    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378348    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378358    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378369    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378380    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e729c6bb-7337-4107-9833-b75ca14a82ab" volumeName="kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378390    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49f381dd-faeb-4e5a-bf51-c0adfb0837e3" volumeName="kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378401    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378413    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f02514a-3fb9-4bce-adec-87f1e75304a7" volumeName="kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378424    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378435    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fff5edd-ad77-4f60-8b68-007782672512" volumeName="kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378817    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378852    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="413fb1a4-8787-4838-89bb-2f08bc170795" volumeName="kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p" seLinuxMountContext=""
Oct 30 23:07:08.379191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.378880    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379296    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379323    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379346    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379361    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379381    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd3bcdb3-39da-41d5-9ebf-59116a07baf9" volumeName="kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379476    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379490    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379511    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379600    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="389f431d-8f1c-4f9c-8cac-e270a08b731a" volumeName="kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379656    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f18d2b48-cfd3-4963-89e3-468f7a468c71" volumeName="kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379672    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="201241b0-a25e-4c89-9d64-c33bde6637c1" volumeName="kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379685    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f02514a-3fb9-4bce-adec-87f1e75304a7" volumeName="kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379704    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379760    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b78d601-a26c-4cd3-ac5c-eea7b658f07f" volumeName="kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379772    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379791    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f02514a-3fb9-4bce-adec-87f1e75304a7" volumeName="kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379804    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64763c7a-6a43-4764-9fc5-b1e16d1f6c80" volumeName="kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379822    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a50d5730-1bd4-4cea-8915-4a7d9ba6fc02" volumeName="kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379835    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379849    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379862    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379872    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e729c6bb-7337-4107-9833-b75ca14a82ab" volumeName="kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379884    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379893    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379903    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="413fb1a4-8787-4838-89bb-2f08bc170795" volumeName="kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379914    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b78d601-a26c-4cd3-ac5c-eea7b658f07f" volumeName="kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379923    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234" volumeName="kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379936    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379944    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379952    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5961be49-a9c6-44f7-9c9a-ec04c0dc7226" volumeName="kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379964    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b78d601-a26c-4cd3-ac5c-eea7b658f07f" volumeName="kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379972    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f699aea-caae-4dd7-a01d-edfaf2b23387" volumeName="kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379984    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.379994    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380003    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe" volumeName="kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380014    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380022    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c57fb91a-da7c-45fb-b508-c104c4e623ab" volumeName="kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380033    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eddd2b94-9f61-44bb-a171-ade17ebc3f2a" volumeName="kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380041    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" volumeName="kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380051    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acc9e4a-82b7-4e08-9927-f4318943b4fd" volumeName="kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380062    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d589edbb-387b-4a9f-8a8e-171a2fff06cf" volumeName="kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380070    6126 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deb415ec-3e02-40b4-bee6-419ae59a6658" volumeName="kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7" seLinuxMountContext=""
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380080    6126 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 23:07:08.380699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.380085    6126 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 23:07:08.398164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.396538    6126 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 23:07:08.398371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.398352    6126 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 23:07:08.398454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.398373    6126 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 23:07:08.398454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.398395    6126 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 23:07:08.398454 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.398434    6126 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 23:07:08.413162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.413095    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:07:08.416753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.416714    6126 generic.go:356] "Generic (PLEG): container finished" podID="f6b2b7fd86cc32af94d49c01fec62d0e" containerID="48d80bf93bf306141989005dbab1979304b7d9ba9fa619830398fb32225f83dd" exitCode=0
Oct 30 23:07:08.419751 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.419727    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:07:08.421710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.421682    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="68f5d6a5bc8adaaf98685eb00b943fb3022ac8f8a148370b08fbabcdfcc78e3c" exitCode=0
Oct 30 23:07:08.456204 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.456177    6126 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:07:08.460012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.459985    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d" exitCode=0
Oct 30 23:07:08.465297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465268    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="e95d015334effec0f973b046c5a5e5a9acd1f3b643e8c3c8da887a9fac245a05" exitCode=0
Oct 30 23:07:08.465297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465295    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="7f36fa7094529f5f4184f7edb45fb37516a1f1e1ffac01d63d73162bbb0b710e" exitCode=0
Oct 30 23:07:08.465297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465303    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="1b65845a621c0935a868a630bee33020208f2038a402b07072d38c232a137f54" exitCode=0
Oct 30 23:07:08.465500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465310    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="8eb95094dbb0755f0fe8f9a1806722d665a56a0d7343e195cbc6ff2c0d61fa23" exitCode=0
Oct 30 23:07:08.465500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465318    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="9c49f29beb73bf325ce48af13965b537ace6d8ccd00f588f6b861255afde2db6" exitCode=0
Oct 30 23:07:08.465500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.465323    6126 generic.go:356] "Generic (PLEG): container finished" podID="f18d2b48-cfd3-4963-89e3-468f7a468c71" containerID="e723569ced525a7baa65a14887f07d425268d1515a47486dcb1f8477a1bd1ad6" exitCode=0
Oct 30 23:07:08.476461 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.476438    6126 generic.go:356] "Generic (PLEG): container finished" podID="201241b0-a25e-4c89-9d64-c33bde6637c1" containerID="98f4240d28fcd188e77963813fe359a27b577de2932463351ee43d2b90da4b04" exitCode=0
Oct 30 23:07:08.491175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.491152    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:07:08.491528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.491496    6126 generic.go:356] "Generic (PLEG): container finished" podID="5f02514a-3fb9-4bce-adec-87f1e75304a7" containerID="51624f0865bf0052958d142302a7715dd28cb6f540b05e0edcedeba318490164" exitCode=1
Oct 30 23:07:08.498521 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.498499    6126 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 23:07:08.518573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.518547    6126 manager.go:324] Recovery completed
Oct 30 23:07:08.536071 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.536044    6126 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 23:07:08.547680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.547658    6126 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:07:08.549681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.549660    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:07:08.549773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.549699    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:07:08.549773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.549717    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:07:08.553779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553752    6126 cpu_manager.go:226] "Starting" policy="none"
Oct 30 23:07:08.553779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553773    6126 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 23:07:08.553948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553780    6126 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:07:08.553948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553792    6126 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 23:07:08.553948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553925    6126 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553940    6126 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553959    6126 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553965    6126 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553970    6126 policy_none.go:50] "Start"
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.553990    6126 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 23:07:08.554087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554001    6126 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 23:07:08.554318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554137    6126 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 23:07:08.554318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554145    6126 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 23:07:08.554318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554150    6126 policy_none.go:44] "Start"
Oct 30 23:07:08.554834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554818    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:07:08.554927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554850    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:07:08.554927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.554861    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:07:08.556324 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.556298    6126 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:07:08.560283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.560253    6126 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 23:07:08.566557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.566543    6126 manager.go:341] "Starting Device Plugin manager"
Oct 30 23:07:08.566665 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.566573    6126 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 23:07:08.566665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.566583    6126 server.go:87] "Starting device plugin registration server"
Oct 30 23:07:08.566913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.566895    6126 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 23:07:08.567652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.566914    6126 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 23:07:08.567793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.567772    6126 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 23:07:08.567917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.567878    6126 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 23:07:08.567977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.567932    6126 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 23:07:08.567977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.567939    6126 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 23:07:08.568071 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.567987    6126 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:07:08.567916299Z","UUID":"ced33f18-c8f8-4fcd-862b-f7f1f4bb8392","Handler":null,"Name":"","Endpoint":""}
Oct 30 23:07:08.569599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.569580    6126 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 23:07:08.569723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.569644    6126 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 23:07:08.570755 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.570690    6126 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 23:07:08.570755 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.570738    6126 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-110.us-west-1.compute.internal\" not found"
Oct 30 23:07:08.586424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.586404    6126 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:07:08.586424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.586419    6126 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:07:08.591088 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.591056    6126 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:07:08.637497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.637463    6126 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:07:08.670202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.670137    6126 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:07:08.671420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.671389    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:07:08.671524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.671429    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:07:08.671524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.671440    6126 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-110.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:07:08.671648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.671544    6126 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.698847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.698780    6126 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"]
Oct 30 23:07:08.699830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.699777    6126 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.699830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.699787    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerStarted","Data":"e9721300e619360075ea64b15b055cb09ae97fe6961f7ea9b65370342bb0db69"}
Oct 30 23:07:08.699998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.699837    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerDied","Data":"48d80bf93bf306141989005dbab1979304b7d9ba9fa619830398fb32225f83dd"}
Oct 30 23:07:08.699998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.699860    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"f6b2b7fd86cc32af94d49c01fec62d0e","Type":"ContainerStarted","Data":"6eb80c70cdcdf93642f95cb13afd971d7893954ced417d2a8abbcb7c61e9a361"}
Oct 30 23:07:08.699998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.699995    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"a483a0a2f224f7b88a6328294b47ee65","Type":"ContainerStarted","Data":"127a31717f05f6266c4627362cd760489d39481ef5d21a2698a1aa56f40af411"}
Oct 30 23:07:08.700150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.700013    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal" event={"ID":"a483a0a2f224f7b88a6328294b47ee65","Type":"ContainerStarted","Data":"6129ac6e48fd3cdba253b8816bb6faf6d34a7bf9d0c1a8f8e38485eda5594ac3"}
Oct 30 23:07:08.700150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.700038    6126 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.767564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.767523    6126 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:07:08.767756 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.767587    6126 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.767756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.767535    6126 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:07:08.767756 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:08.767694    6126 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.783450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.783420    6126 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.783590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.783488    6126 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.838024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.837989    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.838024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.838032    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.838285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.838069    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938447    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938499    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938539    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938540    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938589    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a483a0a2f224f7b88a6328294b47ee65-config\") pod \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"a483a0a2f224f7b88a6328294b47ee65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:08.938781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:08.938603    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b2b7fd86cc32af94d49c01fec62d0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" (UID: \"f6b2b7fd86cc32af94d49c01fec62d0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:09.320955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.320920    6126 apiserver.go:52] "Watching apiserver"
Oct 30 23:07:09.475694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.475657    6126 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 23:07:09.476488 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.476459    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx","openshift-console/console-689bbf5654-hrm8r","kube-system/konnectivity-agent-jqqzd","openshift-monitoring/telemeter-client-bb769446-4pf69","openshift-ingress-canary/ingress-canary-dr89q","openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f","openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz","openshift-multus/network-metrics-daemon-9mwnl","openshift-ovn-kubernetes/ovnkube-node-9x2kt","openshift-multus/multus-additional-cni-plugins-twrvp","openshift-network-operator/iptables-alerter-n6trp","openshift-monitoring/metrics-server-dcddbd87f-zwc2x","openshift-network-diagnostics/network-check-target-94xqm","openshift-console/console-996d7c98d-jbv7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal","openshift-console/console-7c9495d56b-dvsfw","openshift-multus/multus-n92qr","openshift-monitoring/alertmanager-main-0","openshift-monitoring/prometheus-operator-9cd89b74c-xgh98","openshift-dns/dns-default-4krlr","openshift-image-registry/node-ca-h2t9s","openshift-monitoring/prometheus-k8s-0","openshift-dns/node-resolver-z9k87","openshift-insights/insights-runtime-extractor-bwwqq","openshift-monitoring/monitoring-plugin-77f4f76594-cr55m","openshift-monitoring/node-exporter-2pjh2","openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q","kube-system/global-pull-secret-syncer-6wk6h","openshift-cluster-node-tuning-operator/tuned-hm45r","openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8","openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:07:09.498441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.498413    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.504702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.504674    6126 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:09.504855 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.504838    6126 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:09.530520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530495    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.530718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530699    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 23:07:09.530798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530707    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 23:07:09.530798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530707    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.530798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530753    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.530955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530869    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 23:07:09.530955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.530895    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 23:07:09.531058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531037    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.531107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531059    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 23:07:09.531171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531156    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4qgbv\""
Oct 30 23:07:09.531218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531163    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7sr97\""
Oct 30 23:07:09.531386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531339    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fbzzd\""
Oct 30 23:07:09.531480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531398    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 23:07:09.531534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531483    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 23:07:09.531534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531513    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-trr47\""
Oct 30 23:07:09.531655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531639    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.531763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.531748    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-46zpf\""
Oct 30 23:07:09.532064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.532045    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.532129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.532099    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 23:07:09.532355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.532342    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7m4ss\""
Oct 30 23:07:09.533603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533583    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nlg56\""
Oct 30 23:07:09.533719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533633    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.533777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533738    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 23:07:09.533777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533764    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 23:07:09.533875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533800    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.533875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533851    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 23:07:09.533952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533917    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.533952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533948    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.534040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.533976    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 23:07:09.534040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.534021    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t7twr\""
Oct 30 23:07:09.534137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.534104    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 23:07:09.534240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.534224    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.534347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.534334    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.534430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.534416    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xqsx\""
Oct 30 23:07:09.536435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536421    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ldcvv\""
Oct 30 23:07:09.536651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536606    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.536828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536807    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.536917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536898    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.536963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536941    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4j2qm\""
Oct 30 23:07:09.537011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536942    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 23:07:09.537011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.536998    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.537107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.537096    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tw7s4\""
Oct 30 23:07:09.563929 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.563904    6126 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 23:07:09.581648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581555    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.581648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581594    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.581648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581600    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.581831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581734    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.581831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581757    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 23:07:09.581941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581880    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.582018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581922    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.582018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.581955    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 23:07:09.584680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.584666    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 23:07:09.585540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585526    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 23:07:09.585608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585585    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 23:07:09.585680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585637    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 23:07:09.585810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585796    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 23:07:09.585867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585824    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 23:07:09.585907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585899    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 23:07:09.585960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.585946    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 23:07:09.586919 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.586903    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 23:07:09.586983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.586920    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 23:07:09.586983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.586956    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 23:07:09.587064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.587051    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 23:07:09.587542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.587521    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 23:07:09.587542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.587534    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 23:07:09.587671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.587658    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 23:07:09.638815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638786    6126 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:07:09.639043 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639024    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639044    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639064    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638791    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638827    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638985    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639000    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638792    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 23:07:09.639142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639134    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639157    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639186    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639012    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638797    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639197    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.638899    6126 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:09.639067    6126 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:09.639236    6126 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal"
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639259    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639006    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639130    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639301    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cqcdm\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639317    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639322    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639350    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639358    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639360    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v482q\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639376    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639392    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639409    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639419    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639469    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639469    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r7j85\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639485    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 23:07:09.639502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639511    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4u7qa66bq4aih\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639634    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639675    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639789    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639860    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5qktt\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.639947    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640044    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640063    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s47dt\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640090    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tfc2b\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640107    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wqjlk\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640122    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640125    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640147    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xvjkf\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640175    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640195    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640199    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640213    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640213    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7fhmg\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640226    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640230    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5sdcn\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640249    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x648d\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640267    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jqp2d\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640348    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-l6bwx\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640392    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640476    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7utij12jgulav\""
Oct 30 23:07:09.640591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640541    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640639    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640733    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hlqvv\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640791    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640801    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640878    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640951    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cff4m9cl3lci8\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.640999    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.641174    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.641234    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vl5rp\""
Oct 30 23:07:09.641476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.641436    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 23:07:09.643569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643548    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.643653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643578    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.643653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643600    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5nq\" (UniqueName: \"kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:09.643653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643645    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.643748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643671    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.643748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643711    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.643856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643836    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.643902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643878    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.643939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643911    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcw7l\" (UniqueName: \"kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.643969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643936    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.643969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643936    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.643969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643959    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.644117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643962    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fb29279-c313-451b-bec0-8564faf340ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.644117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.643964    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.644117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644025    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gs59\" (UniqueName: \"kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.644117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644072    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.644117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644111    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.644277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644152    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.644277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644192    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.644277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644231    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd46d589-b55e-4971-9abc-1595f7d4a900-original-pull-secret\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.644277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644228    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.644419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644281    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.644419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644325    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqlq7\" (UniqueName: \"kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.644419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644357    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.644419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644383    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-tls\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.644419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644385    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xq4g\" (UniqueName: \"kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.644672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644424    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.644672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644449    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.644672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644472    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.644672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644582    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.644672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644584    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.644831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644670    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.644831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644688    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6lz\" (UniqueName: \"kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.644831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644722    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.644831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644751    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.644831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644787    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.644996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644836    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.644996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644916    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.644996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644946    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.645090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.644998    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.645090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645070    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645102    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.645152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645099    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.645152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645123    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.645152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645108    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.645281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645157    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.645281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645183    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645231    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:09.645281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645246    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8effbcce-e26d-409a-8537-ee344af6f563-tmp-dir\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645279    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645310    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645323    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645352    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645380    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645396    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fff5edd-ad77-4f60-8b68-007782672512-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:09.645404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645401    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.645609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645478    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-tmp\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.645609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645480    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcc4k\" (UniqueName: \"kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.645609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645506    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.645609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645524    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.645609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645549    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645655    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovn-node-metrics-cert\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.645774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645746    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645760    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.645774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645768    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645780    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:09.645901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645804    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.645901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645819    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.645901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645836    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/389f431d-8f1c-4f9c-8cac-e270a08b731a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.646028 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645903    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.646028 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645922    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.646028 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645946    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.646028 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.645962    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.646145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646076    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.646145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646110    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.646145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646123    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.646145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646127    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:07:09.646269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646155    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.646269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646262    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.646334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646282    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.646334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646298    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.646334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646317    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.646426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646329    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.646426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646354    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.646426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646370    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e729c6bb-7337-4107-9833-b75ca14a82ab-agent-certs\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:07:09.646426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646378    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.646540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646429    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.646540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646465    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.646605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct66p\" (UniqueName: \"kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.646605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646587    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.646678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646663    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.646720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646660    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.646720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646700    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.646815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646794    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.646867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646813    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.646901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646870    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.646935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646899    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.646935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.646919    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.647017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647004    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.647052 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647024    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.647102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647078    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.647162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647147    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.647206 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647192    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.647255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647241    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.647305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647288    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpbp\" (UniqueName: \"kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.647335 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647322    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.647368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647346    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.647422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647407    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.647456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647423    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-federate-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.647528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647510    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.647580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647539    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.647580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647563    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.647673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647570    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.647673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647634    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.647673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647657    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.647769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647673    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gb7l\" (UniqueName: \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.647769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647692    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.647769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647721    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.647769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647737    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.647769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647752    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647849    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647948    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647969    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647985    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.648002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.647987    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648094    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648122    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767ef969-8394-4941-84fb-beda11cc4709-metrics-certs\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648147    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648165    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648181    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648179    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648196    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648230    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648233    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.648271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648259    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-grpc-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648273    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648302    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648325    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648342    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648383    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648387    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648404    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648428    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-script-lib\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648432    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648481    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzsx\" (UniqueName: \"kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648499    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.648530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648508    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648536    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648610    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-ovnkube-config\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648653    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-tls\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648663    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648718    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbn7\" (UniqueName: \"kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648751    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648780    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648797    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648808    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mcmg\" (UniqueName: \"kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648891    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-serving-certs-ca-bundle\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648902    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648905    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn2h\" (UniqueName: \"kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648934    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648940    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648961    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.649009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.648995    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649036    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5b7\" (UniqueName: \"kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649062    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649089    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqngl\" (UniqueName: \"kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649116    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649146    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsst\" (UniqueName: \"kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649167    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649190    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649219    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649284    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649294    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649306    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649323    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649411    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649430    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-client-ca-bundle\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649436    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649465    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649477    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649481    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-textfile\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649532    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649594    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649604    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.649686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649609    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cni-binary-copy\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649666    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x75n\" (UniqueName: \"kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.649986    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650040    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650077    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650144    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650369    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650511    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.650553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650534    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650537    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650597    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650759    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650799    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650801    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650865    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.650942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.650930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4hk\" (UniqueName: \"kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.651248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651109    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.651248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651155    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.651248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651196    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.651248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651202    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.651442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651267    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.651593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651574    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.651756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651632    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.651756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651704    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.651904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651768    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.651904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651801    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.651904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651874    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-2fm7f\" (UID: \"afdd3a1c-cea6-480a-b43f-adf808299dde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:07:09.651904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651901    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.652168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651931    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.652168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651968    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.652168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.651999    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.652168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652037    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.652168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652073    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652222    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652255    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652257    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-metrics-client-ca\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652279    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652310    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652344    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-audit-log\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652346    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652396    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.652497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652438    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szs8p\" (UniqueName: \"kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652476    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652538    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-config-volume\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652658    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652668    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-tmp\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652706    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cz7\" (UniqueName: \"kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652740    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652765    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652797    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652863    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652901    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652928    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652959    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.652994    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653026    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653056    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.653127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653081    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653243    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653300    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653342    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653376    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653412    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653463    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653474    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fb29279-c313-451b-bec0-8564faf340ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653488    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653521    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653552    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653586    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653632    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653659    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653691    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653731    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-telemeter-client-tls\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653733    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653795    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653835    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653869    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653907    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.653944    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654004    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654042    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.654311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654108    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654334    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-metrics-server-audit-profiles\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654356    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654389    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654426    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654459    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654494    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654531    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654547    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654592    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654650    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654683    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654717    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654745    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654779    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654813    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654845    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.654865    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655116    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afdd3a1c-cea6-480a-b43f-adf808299dde-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-2fm7f\" (UID: \"afdd3a1c-cea6-480a-b43f-adf808299dde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655338    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655476    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/413fb1a4-8787-4838-89bb-2f08bc170795-serviceca\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655549    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655732    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-secret-metrics-server-client-certs\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.655797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655775    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655916    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-metrics-client-ca\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.655944    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656079    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656169    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-metrics-tls\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656261    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656394    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656423    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e729c6bb-7337-4107-9833-b75ca14a82ab-konnectivity-ca\") pod \"konnectivity-agent-jqqzd\" (UID: \"e729c6bb-7337-4107-9833-b75ca14a82ab\") " pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656667    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656692    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-tuned\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656703    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-daemon-config\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656780    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656909    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18d2b48-cfd3-4963-89e3-468f7a468c71-cni-binary-copy\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656963    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656961    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.657041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.656997    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deb415ec-3e02-40b4-bee6-419ae59a6658-cert\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657063    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-tmp-dir\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657104    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b296a934-af68-4984-8c70-0561822d5f17-iptables-alerter-script\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657198    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657205    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657282    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb29279-c313-451b-bec0-8564faf340ef-data-volume\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657282    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657480    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f02514a-3fb9-4bce-adec-87f1e75304a7-env-overrides\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657560    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389f431d-8f1c-4f9c-8cac-e270a08b731a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657562    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.657599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657562    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.658384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657695    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/201241b0-a25e-4c89-9d64-c33bde6637c1-metrics-client-ca\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.658384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.657827    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.658384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.658017    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.658384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.658251    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.661584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.661564    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.699725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.699697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5nq\" (UniqueName: \"kubernetes.io/projected/1fff5edd-ad77-4f60-8b68-007782672512-kube-api-access-kv5nq\") pod \"monitoring-plugin-77f4f76594-cr55m\" (UID: \"1fff5edd-ad77-4f60-8b68-007782672512\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:09.702437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702387    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gs59\" (UniqueName: \"kubernetes.io/projected/201241b0-a25e-4c89-9d64-c33bde6637c1-kube-api-access-6gs59\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.702540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702500    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcw7l\" (UniqueName: \"kubernetes.io/projected/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-kube-api-access-vcw7l\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.702638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702573    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcc4k\" (UniqueName: \"kubernetes.io/projected/1fb29279-c313-451b-bec0-8564faf340ef-kube-api-access-rcc4k\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.702638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702588    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"console-996d7c98d-jbv7s\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") " pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:09.702724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702685    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6lz\" (UniqueName: \"kubernetes.io/projected/a50d5730-1bd4-4cea-8915-4a7d9ba6fc02-kube-api-access-nc6lz\") pod \"openshift-state-metrics-7bd7489957-mqwj8\" (UID: \"a50d5730-1bd4-4cea-8915-4a7d9ba6fc02\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqwj8"
Oct 30 23:07:09.702724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702706    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqlq7\" (UniqueName: \"kubernetes.io/projected/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-kube-api-access-mqlq7\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.702797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702738    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xq4g\" (UniqueName: \"kubernetes.io/projected/389f431d-8f1c-4f9c-8cac-e270a08b731a-kube-api-access-9xq4g\") pod \"prometheus-operator-9cd89b74c-xgh98\" (UID: \"389f431d-8f1c-4f9c-8cac-e270a08b731a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-xgh98"
Oct 30 23:07:09.702913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.702897    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2r4\" (UniqueName: \"kubernetes.io/projected/e9f2ae1d-bfae-48b3-869b-b779f230415a-kube-api-access-mn2r4\") pod \"network-check-target-94xqm\" (UID: \"e9f2ae1d-bfae-48b3-869b-b779f230415a\") " pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:09.704556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.704537    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct66p\" (UniqueName: \"kubernetes.io/projected/413fb1a4-8787-4838-89bb-2f08bc170795-kube-api-access-ct66p\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.706802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.706758    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"console-689bbf5654-hrm8r\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") " pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:09.706911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.706776    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"alertmanager-main-0\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:09.707076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.707059    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpbp\" (UniqueName: \"kubernetes.io/projected/6b78d601-a26c-4cd3-ac5c-eea7b658f07f-kube-api-access-5hpbp\") pod \"dns-default-4krlr\" (UID: \"6b78d601-a26c-4cd3-ac5c-eea7b658f07f\") " pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:09.707112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.707071    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"prometheus-k8s-0\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:09.707316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.707294    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"console-5bb4968b4d-mm6ms\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") " pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:09.707805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.707783    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mcmg\" (UniqueName: \"kubernetes.io/projected/5f02514a-3fb9-4bce-adec-87f1e75304a7-kube-api-access-7mcmg\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.707922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.707870    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5b7\" (UniqueName: \"kubernetes.io/projected/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kube-api-access-6c5b7\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.708283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.708263    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbn7\" (UniqueName: \"kubernetes.io/projected/deb415ec-3e02-40b4-bee6-419ae59a6658-kube-api-access-7sbn7\") pod \"ingress-canary-dr89q\" (UID: \"deb415ec-3e02-40b4-bee6-419ae59a6658\") " pod="openshift-ingress-canary/ingress-canary-dr89q"
Oct 30 23:07:09.708362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.708324    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqngl\" (UniqueName: \"kubernetes.io/projected/b296a934-af68-4984-8c70-0561822d5f17-kube-api-access-bqngl\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.708362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.708326    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x75n\" (UniqueName: \"kubernetes.io/projected/767ef969-8394-4941-84fb-beda11cc4709-kube-api-access-2x75n\") pod \"network-metrics-daemon-9mwnl\" (UID: \"767ef969-8394-4941-84fb-beda11cc4709\") " pod="openshift-multus/network-metrics-daemon-9mwnl"
Oct 30 23:07:09.708434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.708360    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn2h\" (UniqueName: \"kubernetes.io/projected/8effbcce-e26d-409a-8537-ee344af6f563-kube-api-access-2gn2h\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.708940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.708924    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzsx\" (UniqueName: \"kubernetes.io/projected/64763c7a-6a43-4764-9fc5-b1e16d1f6c80-kube-api-access-jdzsx\") pod \"thanos-querier-7bb8f9bc4d-56t2q\" (UID: \"64763c7a-6a43-4764-9fc5-b1e16d1f6c80\") " pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:09.709884 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.709867    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsst\" (UniqueName: \"kubernetes.io/projected/5961be49-a9c6-44f7-9c9a-ec04c0dc7226-kube-api-access-zzsst\") pod \"telemeter-client-bb769446-4pf69\" (UID: \"5961be49-a9c6-44f7-9c9a-ec04c0dc7226\") " pod="openshift-monitoring/telemeter-client-bb769446-4pf69"
Oct 30 23:07:09.738935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.738901    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szs8p\" (UniqueName: \"kubernetes.io/projected/f18d2b48-cfd3-4963-89e3-468f7a468c71-kube-api-access-szs8p\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.739158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.739024    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cz7\" (UniqueName: \"kubernetes.io/projected/bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234-kube-api-access-q9cz7\") pod \"kube-state-metrics-5dc8d7d89b-wtbcz\" (UID: \"bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-wtbcz"
Oct 30 23:07:09.739158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.739056    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4hk\" (UniqueName: \"kubernetes.io/projected/a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe-kube-api-access-kh4hk\") pod \"metrics-server-dcddbd87f-zwc2x\" (UID: \"a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe\") " pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:09.755860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755834    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.755974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755865    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.755974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755886    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.755974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755902    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.755974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755918    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.755974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755960    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8effbcce-e26d-409a-8537-ee344af6f563-hosts-file\") pod \"node-resolver-z9k87\" (UID: \"8effbcce-e26d-409a-8537-ee344af6f563\") " pod="openshift-dns/node-resolver-z9k87"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755975    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-systemd\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755985    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b296a934-af68-4984-8c70-0561822d5f17-host-slash\") pod \"iptables-alerter-n6trp\" (UID: \"b296a934-af68-4984-8c70-0561822d5f17\") " pod="openshift-network-operator/iptables-alerter-n6trp"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755975    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/413fb1a4-8787-4838-89bb-2f08bc170795-host\") pod \"node-ca-h2t9s\" (UID: \"413fb1a4-8787-4838-89bb-2f08bc170795\") " pod="openshift-image-registry/node-ca-h2t9s"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.755966    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-cnibin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756018    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756048    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756073    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756089    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756050    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-conf-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756109    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756147    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-socket-dir-parent\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756151    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-etc-kubernetes\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756150    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756160    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-netns\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756170    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-systemd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756170    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-multus-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756190    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756211    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-netns\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756212    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gb7l\" (UniqueName: \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756237    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756264    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756268    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-cnibin\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756290    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756309    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-root\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756319    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756345    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756370    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756345    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-system-cni-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756399    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756374    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-kubelet\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756434    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-run\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756446    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-system-cni-dir\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756468    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756493    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756514    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756519    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fb29279-c313-451b-bec0-8564faf340ef-crio-socket\") pod \"insights-runtime-extractor-bwwqq\" (UID: \"1fb29279-c313-451b-bec0-8564faf340ef\") " pod="openshift-insights/insights-runtime-extractor-bwwqq"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756535    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756554    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-sys-fs\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756566    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-netd\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756561    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756593    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-host\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756606    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756641    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-var-lib-kubelet\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756666    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756690    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756700    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-modprobe-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756715    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756725    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-etc-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756741    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756759    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-hostroot\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756765    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756787    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-multus-certs\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756788    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756745    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-ovn\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756830    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-systemd-units\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756830    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.756864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756877    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756843    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-kubernetes\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756906    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756945    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-node-exporter-wtmp\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756963    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.756999    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757034    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757036    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757000    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/201241b0-a25e-4c89-9d64-c33bde6637c1-sys\") pod \"node-exporter-2pjh2\" (UID: \"201241b0-a25e-4c89-9d64-c33bde6637c1\") " pod="openshift-monitoring/node-exporter-2pjh2"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757099    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757109    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757125    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757151    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757173    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757178    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-slash\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757200    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757223    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-conf\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757203    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-node-log\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757237    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-log-socket\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757235    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757266    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757278    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-kubelet-config\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757281    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757305    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757356    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757334    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757380    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757382    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-multus\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757405    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757407    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-run-k8s-cni-cncf-io\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757420    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysconfig\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757427    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757443    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757447    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757451    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-host-cni-bin\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757488    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-sys\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757497    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757518    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757539    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18d2b48-cfd3-4963-89e3-468f7a468c71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twrvp\" (UID: \"f18d2b48-cfd3-4963-89e3-468f7a468c71\") " pod="openshift-multus/multus-additional-cni-plugins-twrvp"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757541    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757570    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-registration-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757577    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757608    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757653    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757681    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757692    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-etc-sysctl-d\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757707    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757708    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757738    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-cni-bin\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757757    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757784    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757734    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f381dd-faeb-4e5a-bf51-c0adfb0837e3-lib-modules\") pod \"tuned-hm45r\" (UID: \"49f381dd-faeb-4e5a-bf51-c0adfb0837e3\") " pod="openshift-cluster-node-tuning-operator/tuned-hm45r"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757734    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd46d589-b55e-4971-9abc-1595f7d4a900-dbus\") pod \"global-pull-secret-syncer-6wk6h\" (UID: \"fd46d589-b55e-4971-9abc-1595f7d4a900\") " pod="kube-system/global-pull-secret-syncer-6wk6h"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757810    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757865    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-socket-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757895    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757915    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-run-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757923    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757955    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757919    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f02514a-3fb9-4bce-adec-87f1e75304a7-var-lib-openvswitch\") pod \"ovnkube-node-9x2kt\" (UID: \"5f02514a-3fb9-4bce-adec-87f1e75304a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.757988    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.758054    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eddd2b94-9f61-44bb-a171-ade17ebc3f2a-device-dir\") pod \"aws-ebs-csi-driver-node-n29gx\" (UID: \"eddd2b94-9f61-44bb-a171-ade17ebc3f2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n29gx"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.758069    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.758076    6126 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 23:07:09.758984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.758124    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3bcdb3-39da-41d5-9ebf-59116a07baf9-host-var-lib-kubelet\") pod \"multus-n92qr\" (UID: \"bd3bcdb3-39da-41d5-9ebf-59116a07baf9\") " pod="openshift-multus/multus-n92qr"
Oct 30 23:07:09.761809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.760822    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.761809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.761263    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:09.796904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.796886    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:07:09.814047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:09.814019    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gb7l\" (UniqueName: \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\") pod \"console-7c9495d56b-dvsfw\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") " pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:10.111942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:10.111912    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:10.237495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:10.237460    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-2fm7f"
Oct 30 23:07:10.369092 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:10.369018    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4krlr"
Oct 30 23:07:10.481710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:10.481682    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9495d56b-dvsfw"]
Oct 30 23:07:10.485332 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:10.485303    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3febcfb0_7521_459f_9117_b41cd68c7150.slice/crio-57aeed18242409557cc240fe66c6ddb3fb87f2099e6f9bcea26c1f55a95f9ff8 WatchSource:0}: Error finding container 57aeed18242409557cc240fe66c6ddb3fb87f2099e6f9bcea26c1f55a95f9ff8: Status 404 returned error can't find the container with id 57aeed18242409557cc240fe66c6ddb3fb87f2099e6f9bcea26c1f55a95f9ff8
Oct 30 23:07:10.510893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:10.510862    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9495d56b-dvsfw" event={"ID":"3febcfb0-7521-459f-9117-b41cd68c7150","Type":"ContainerStarted","Data":"57aeed18242409557cc240fe66c6ddb3fb87f2099e6f9bcea26c1f55a95f9ff8"}
Oct 30 23:07:11.520141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.520092    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9495d56b-dvsfw" event={"ID":"3febcfb0-7521-459f-9117-b41cd68c7150","Type":"ContainerStarted","Data":"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"}
Oct 30 23:07:11.523803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.523776    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"}
Oct 30 23:07:11.523925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.523852    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"}
Oct 30 23:07:11.523925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.523893    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"}
Oct 30 23:07:11.524012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.523938    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"}
Oct 30 23:07:11.524012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.523978    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"}
Oct 30 23:07:11.524107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.524014    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerStarted","Data":"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"}
Oct 30 23:07:11.843476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:11.843391    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:12.075257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:12.075229    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:12.295789 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:12.295728    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7c9495d56b-dvsfw" podStartSLOduration=4.295713407 podStartE2EDuration="4.295713407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:12.294503372 +0000 UTC m=+4.054595982" watchObservedRunningTime="2026-10-30 23:07:12.295713407 +0000 UTC m=+4.055805978"
Oct 30 23:07:12.463789 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:12.463754    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:13.321912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:13.321876    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:13.326194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:13.326170    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bb8f9bc4d-56t2q"
Oct 30 23:07:14.318232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:14.318203    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jqqzd"
Oct 30 23:07:15.007348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:15.007312    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:15.223820 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:15.223736    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:15.749113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:15.749085    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:15.749341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:15.749329    6126 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:07:16.256845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:16.256809    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:16.261394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:16.261374    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-cr55m"
Oct 30 23:07:17.439864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:17.439836    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x2kt"
Oct 30 23:07:18.333591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:18.333562    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:19.467224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:19.467185    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:19.518488 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:19.518458    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:19.579333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:19.579305    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:20.404345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:20.404319    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:20.406716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:20.406693    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:20.571284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:20.571257    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:07:20.729915 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:20.729884    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:07:21.411376 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:21.411349    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:25.995782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:25.995741    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5845f8c79-2twqk"]
Oct 30 23:07:26.082266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.082230    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.101221 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.101194    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5845f8c79-2twqk"]
Oct 30 23:07:26.118960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.118931    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-oauth-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119082 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.118986    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-trusted-ca-bundle\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119082 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119059    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-console-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119093    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6593594-5b92-4f24-b605-64ba5f53b343-tmp\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119130    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv52b\" (UniqueName: \"kubernetes.io/projected/e6593594-5b92-4f24-b605-64ba5f53b343-kube-api-access-jv52b\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119214    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119258    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-oauth-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.119313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.119304    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-service-ca\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220234    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv52b\" (UniqueName: \"kubernetes.io/projected/e6593594-5b92-4f24-b605-64ba5f53b343-kube-api-access-jv52b\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220292    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220338    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-oauth-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220354    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-service-ca\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220390    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-oauth-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220443    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-trusted-ca-bundle\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220470    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-console-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.220690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.220495    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6593594-5b92-4f24-b605-64ba5f53b343-tmp\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.221202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.221139    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6593594-5b92-4f24-b605-64ba5f53b343-tmp\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.221343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.221279    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-service-ca\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.221343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.221330    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-console-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.221751 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.221726    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-oauth-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.221803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.221765    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6593594-5b92-4f24-b605-64ba5f53b343-trusted-ca-bundle\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.223063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.223041    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-oauth-config\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.223238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.223221    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6593594-5b92-4f24-b605-64ba5f53b343-console-serving-cert\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.278733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.278667    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv52b\" (UniqueName: \"kubernetes.io/projected/e6593594-5b92-4f24-b605-64ba5f53b343-kube-api-access-jv52b\") pod \"console-5845f8c79-2twqk\" (UID: \"e6593594-5b92-4f24-b605-64ba5f53b343\") " pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.413583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.413550    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:26.816891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:26.816850    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5845f8c79-2twqk"]
Oct 30 23:07:26.819910 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:26.819884    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6593594_5b92_4f24_b605_64ba5f53b343.slice/crio-ac2fb3941f72ca627229c30f2eecfd2c86b0014d4f4f23ffd7a3f910392743a7 WatchSource:0}: Error finding container ac2fb3941f72ca627229c30f2eecfd2c86b0014d4f4f23ffd7a3f910392743a7: Status 404 returned error can't find the container with id ac2fb3941f72ca627229c30f2eecfd2c86b0014d4f4f23ffd7a3f910392743a7
Oct 30 23:07:27.599802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:27.599766    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5845f8c79-2twqk" event={"ID":"e6593594-5b92-4f24-b605-64ba5f53b343","Type":"ContainerStarted","Data":"1c2188995e5c63ac897283ee9bac31605a1419ba11e70086ea2bba2671ae6139"}
Oct 30 23:07:27.600180 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:27.599816    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5845f8c79-2twqk" event={"ID":"e6593594-5b92-4f24-b605-64ba5f53b343","Type":"ContainerStarted","Data":"ac2fb3941f72ca627229c30f2eecfd2c86b0014d4f4f23ffd7a3f910392743a7"}
Oct 30 23:07:27.718132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:27.718077    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5845f8c79-2twqk" podStartSLOduration=2.718062216 podStartE2EDuration="2.718062216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:27.717208385 +0000 UTC m=+19.477300957" watchObservedRunningTime="2026-10-30 23:07:27.718062216 +0000 UTC m=+19.478154783"
Oct 30 23:07:31.481803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.481769    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:31.482219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482037    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="alertmanager" containerID="cri-o://0c2e2e58cc583ca0df507927f2d78cbb79489f4335298bedf4096aa7177b62ff" gracePeriod=120
Oct 30 23:07:31.482219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482112    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-metric" containerID="cri-o://62ba98867c965cd96339a723ebe36cd39cf2e5e6711ccd0345240ec41086ad07" gracePeriod=120
Oct 30 23:07:31.482219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482165    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy" containerID="cri-o://fa16225870e318639eb5fef9c12c0f361175432eaa3b734d2009ee5f8d5a71fc" gracePeriod=120
Oct 30 23:07:31.482381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482118    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-web" containerID="cri-o://5398a11b91c16189d0068217f0d3b5e2c124caecf4c1030e0cef716cb71fdd45" gracePeriod=120
Oct 30 23:07:31.482381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482256    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="prom-label-proxy" containerID="cri-o://1303bff929471c828179c139e23a376c3f1d2ff8a78250569faa885cbccd9a21" gracePeriod=120
Oct 30 23:07:31.482381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.482139    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="config-reloader" containerID="cri-o://c8d24116f5a165688bdc9e4d1ebe7340f98e3776b7f29d56c4620664eabd79ac" gracePeriod=120
Oct 30 23:07:31.620093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620067    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="1303bff929471c828179c139e23a376c3f1d2ff8a78250569faa885cbccd9a21" exitCode=0
Oct 30 23:07:31.620093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620092    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="62ba98867c965cd96339a723ebe36cd39cf2e5e6711ccd0345240ec41086ad07" exitCode=0
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620100    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="fa16225870e318639eb5fef9c12c0f361175432eaa3b734d2009ee5f8d5a71fc" exitCode=0
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620105    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="5398a11b91c16189d0068217f0d3b5e2c124caecf4c1030e0cef716cb71fdd45" exitCode=0
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620110    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="c8d24116f5a165688bdc9e4d1ebe7340f98e3776b7f29d56c4620664eabd79ac" exitCode=0
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620115    6126 generic.go:356] "Generic (PLEG): container finished" podID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerID="0c2e2e58cc583ca0df507927f2d78cbb79489f4335298bedf4096aa7177b62ff" exitCode=0
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620135    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"1303bff929471c828179c139e23a376c3f1d2ff8a78250569faa885cbccd9a21"}
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620205    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"62ba98867c965cd96339a723ebe36cd39cf2e5e6711ccd0345240ec41086ad07"}
Oct 30 23:07:31.620241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620233    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"fa16225870e318639eb5fef9c12c0f361175432eaa3b734d2009ee5f8d5a71fc"}
Oct 30 23:07:31.620454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620262    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"5398a11b91c16189d0068217f0d3b5e2c124caecf4c1030e0cef716cb71fdd45"}
Oct 30 23:07:31.620454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620286    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"c8d24116f5a165688bdc9e4d1ebe7340f98e3776b7f29d56c4620664eabd79ac"}
Oct 30 23:07:31.620454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.620308    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"0c2e2e58cc583ca0df507927f2d78cbb79489f4335298bedf4096aa7177b62ff"}
Oct 30 23:07:31.790506 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.790479    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:31.875659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875627    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.875826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875710    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.875826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875737    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.875826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875755    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.875826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875820    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.876047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875854    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.876047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875882    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.876047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.875915    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876320    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876584    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876718    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876780    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876817    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.876888    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") pod \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\" (UID: \"7acc9e4a-82b7-4e08-9927-f4318943b4fd\") "
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.877223    6126 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.877583    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:31.877849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.877786    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:31.879253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.879207    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:31.879360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.879326    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.879682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.879638    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.879898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.879866    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.879991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.879955    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:31.880158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.880137    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.880708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.880686    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "kube-api-access-87w4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:31.880777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.880707    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.884459 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.884438    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.891268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.891248    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config" pod "7acc9e4a-82b7-4e08-9927-f4318943b4fd" (UID: "7acc9e4a-82b7-4e08-9927-f4318943b4fd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:31.978411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978380    6126 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978418    6126 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-alertmanager-main-db\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978434    6126 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978449    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87w4g\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-kube-api-access-87w4g\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978466    6126 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978480    6126 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978494    6126 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7acc9e4a-82b7-4e08-9927-f4318943b4fd-config-out\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978509    6126 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-web-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978522    6126 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7acc9e4a-82b7-4e08-9927-f4318943b4fd-tls-assets\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978537    6126 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-secret-alertmanager-main-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978551    6126 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7acc9e4a-82b7-4e08-9927-f4318943b4fd-cluster-tls-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:31.978573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:31.978564    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7acc9e4a-82b7-4e08-9927-f4318943b4fd-metrics-client-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:32.627452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.627417    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7acc9e4a-82b7-4e08-9927-f4318943b4fd","Type":"ContainerDied","Data":"4433294e38c4619548715fa47c6669a22daa9c378fcaebc6351bb378e94b6da4"}
Oct 30 23:07:32.627892 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.627488    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.627892 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.627526    6126 scope.go:122] "RemoveContainer" containerID="1303bff929471c828179c139e23a376c3f1d2ff8a78250569faa885cbccd9a21"
Oct 30 23:07:32.635605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.635568    6126 scope.go:122] "RemoveContainer" containerID="62ba98867c965cd96339a723ebe36cd39cf2e5e6711ccd0345240ec41086ad07"
Oct 30 23:07:32.642921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.642897    6126 scope.go:122] "RemoveContainer" containerID="fa16225870e318639eb5fef9c12c0f361175432eaa3b734d2009ee5f8d5a71fc"
Oct 30 23:07:32.649878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.649861    6126 scope.go:122] "RemoveContainer" containerID="5398a11b91c16189d0068217f0d3b5e2c124caecf4c1030e0cef716cb71fdd45"
Oct 30 23:07:32.656522 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.656507    6126 scope.go:122] "RemoveContainer" containerID="c8d24116f5a165688bdc9e4d1ebe7340f98e3776b7f29d56c4620664eabd79ac"
Oct 30 23:07:32.663495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.663476    6126 scope.go:122] "RemoveContainer" containerID="0c2e2e58cc583ca0df507927f2d78cbb79489f4335298bedf4096aa7177b62ff"
Oct 30 23:07:32.670604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.670585    6126 scope.go:122] "RemoveContainer" containerID="68f5d6a5bc8adaaf98685eb00b943fb3022ac8f8a148370b08fbabcdfcc78e3c"
Oct 30 23:07:32.846474 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.846445    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:32.898171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.898137    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:32.898794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.898776    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:32.899109 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899098    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-metric"
Oct 30 23:07:32.899141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899111    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-metric"
Oct 30 23:07:32.899141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899135    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-web"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899140    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-web"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899152    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="prom-label-proxy"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899157    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="prom-label-proxy"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899163    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899168    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899174    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="init-config-reloader"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899178    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="init-config-reloader"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899187    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="alertmanager"
Oct 30 23:07:32.899195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899191    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="alertmanager"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899199    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="config-reloader"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899204    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="config-reloader"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899247    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-metric"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899256    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy-web"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899262    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="prom-label-proxy"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899268    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="kube-rbac-proxy"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899273    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="init-config-reloader"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899278    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="alertmanager"
Oct 30 23:07:32.899456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.899284    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" containerName="config-reloader"
Oct 30 23:07:32.903165 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.903147    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.956786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.956706    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 23:07:32.956786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.956714    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 23:07:32.957445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957430    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 23:07:32.957445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957441    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 23:07:32.957551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957459    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 23:07:32.957551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957479    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 23:07:32.957717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957702    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 23:07:32.957717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.957704    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 23:07:32.958033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.958021    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vl5rp\""
Oct 30 23:07:32.986856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.986826    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ft9\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-kube-api-access-v6ft9\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.986867    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.986885    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-config-out\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987030    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987098    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987139    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-web-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987199    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987220    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987244    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987267    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987346    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987364    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:32.987446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:32.987379    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.007838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.007816    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 23:07:33.015562 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.015522    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:33.088108 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088073    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088108 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088111    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-web-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088135    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088154    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088179    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088202    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088249    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088272    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088298    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088330    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ft9\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-kube-api-access-v6ft9\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088366    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088389    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-config-out\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.088915 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088427    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.089018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.088993    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.090426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.090392    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.091011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.090960    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.091338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.091319    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-web-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.091839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.091810    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.092480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.091998    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.092480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.092365    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.092480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.092390    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.092480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.092416    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.093009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.092989    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.093268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.093246    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37cdb494-de14-49e2-a739-75537cb8c9ad-config-out\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.093319 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.093248    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cdb494-de14-49e2-a739-75537cb8c9ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.147487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.147454    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ft9\" (UniqueName: \"kubernetes.io/projected/37cdb494-de14-49e2-a739-75537cb8c9ad-kube-api-access-v6ft9\") pod \"alertmanager-main-0\" (UID: \"37cdb494-de14-49e2-a739-75537cb8c9ad\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.222436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.222406    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 23:07:33.650270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:33.650192    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 23:07:33.653455 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:33.653425    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cdb494_de14_49e2_a739_75537cb8c9ad.slice/crio-1e6b40a552ed15a3f46014e8c07e3f51a585a14b36f0ad9a9fa72accb59704f8 WatchSource:0}: Error finding container 1e6b40a552ed15a3f46014e8c07e3f51a585a14b36f0ad9a9fa72accb59704f8: Status 404 returned error can't find the container with id 1e6b40a552ed15a3f46014e8c07e3f51a585a14b36f0ad9a9fa72accb59704f8
Oct 30 23:07:34.149659 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:34.149605    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:07:34.404193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.404117    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7acc9e4a-82b7-4e08-9927-f4318943b4fd" path="/var/lib/kubelet/pods/7acc9e4a-82b7-4e08-9927-f4318943b4fd/volumes"
Oct 30 23:07:34.510760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.510718    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-689bbf5654-hrm8r" podUID="0f699aea-caae-4dd7-a01d-edfaf2b23387" containerName="console" containerID="cri-o://5b76150f6b9d06741b02bd8a027a194da9ae572e3452778f4c58c3de505a23ff" gracePeriod=15
Oct 30 23:07:34.513992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.513937    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-996d7c98d-jbv7s" podUID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" containerName="console" containerID="cri-o://5108fd6fdb843e5c9649793812e40371837441ff21db3ad86cc13cd50416e0e2" gracePeriod=15
Oct 30 23:07:34.638269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.638240    6126 generic.go:356] "Generic (PLEG): container finished" podID="37cdb494-de14-49e2-a739-75537cb8c9ad" containerID="711ebaed8aa57281f60056f9e2a44a5fed4e08cf73ccb7aa50088bc61fcdfcc1" exitCode=0
Oct 30 23:07:34.638399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.638328    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerDied","Data":"711ebaed8aa57281f60056f9e2a44a5fed4e08cf73ccb7aa50088bc61fcdfcc1"}
Oct 30 23:07:34.638472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.638404    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"1e6b40a552ed15a3f46014e8c07e3f51a585a14b36f0ad9a9fa72accb59704f8"}
Oct 30 23:07:34.640114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.640090    6126 generic.go:356] "Generic (PLEG): container finished" podID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" containerID="5108fd6fdb843e5c9649793812e40371837441ff21db3ad86cc13cd50416e0e2" exitCode=0
Oct 30 23:07:34.640207 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.640125    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-996d7c98d-jbv7s" event={"ID":"d589edbb-387b-4a9f-8a8e-171a2fff06cf","Type":"ContainerDied","Data":"5108fd6fdb843e5c9649793812e40371837441ff21db3ad86cc13cd50416e0e2"}
Oct 30 23:07:34.642109 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.642072    6126 generic.go:356] "Generic (PLEG): container finished" podID="0f699aea-caae-4dd7-a01d-edfaf2b23387" containerID="5b76150f6b9d06741b02bd8a027a194da9ae572e3452778f4c58c3de505a23ff" exitCode=0
Oct 30 23:07:34.642215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.642152    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689bbf5654-hrm8r" event={"ID":"0f699aea-caae-4dd7-a01d-edfaf2b23387","Type":"ContainerDied","Data":"5b76150f6b9d06741b02bd8a027a194da9ae572e3452778f4c58c3de505a23ff"}
Oct 30 23:07:34.800489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.800417    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:34.808409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.808385    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:34.907430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907407    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.907524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907444    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.907524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907468    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.907524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907492    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.907707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907681    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.907761 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907740    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.907812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907780    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.907870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907826    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.907870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907832    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.907972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907872    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.907972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907910    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.907972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907943    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.908131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.907989    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.908131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908019    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.908131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908106    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.908287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908197    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") pod \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\" (UID: \"d589edbb-387b-4a9f-8a8e-171a2fff06cf\") "
Oct 30 23:07:34.908287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908255    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") pod \"0f699aea-caae-4dd7-a01d-edfaf2b23387\" (UID: \"0f699aea-caae-4dd7-a01d-edfaf2b23387\") "
Oct 30 23:07:34.908394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908348    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.908394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908358    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:34.908502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908414    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.908755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908733    6126 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:34.909062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909044    6126 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f699aea-caae-4dd7-a01d-edfaf2b23387-tmp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:34.909399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909382    6126 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-oauth-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:34.909541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909526    6126 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-trusted-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:34.909664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908804    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.909778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908810    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.909872 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.908808    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.910041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909308    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.910145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909324    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:34.910251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.909363    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:34.910916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.910878    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:34.911540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.911509    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:34.911540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.911532    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:34.911851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.911644    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:34.911851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.911809    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l" pod "d589edbb-387b-4a9f-8a8e-171a2fff06cf" (UID: "d589edbb-387b-4a9f-8a8e-171a2fff06cf"). InnerVolumeSpecName "kube-api-access-xqh8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:34.912592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:34.912301    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5" pod "0f699aea-caae-4dd7-a01d-edfaf2b23387" (UID: "0f699aea-caae-4dd7-a01d-edfaf2b23387"). InnerVolumeSpecName "kube-api-access-t6dg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:35.010901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010877    6126 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-oauth-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.010901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010903    6126 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010914    6126 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010923    6126 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010932    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqh8l\" (UniqueName: \"kubernetes.io/projected/d589edbb-387b-4a9f-8a8e-171a2fff06cf-kube-api-access-xqh8l\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010944    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6dg5\" (UniqueName: \"kubernetes.io/projected/0f699aea-caae-4dd7-a01d-edfaf2b23387-kube-api-access-t6dg5\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010954    6126 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-trusted-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010963    6126 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f699aea-caae-4dd7-a01d-edfaf2b23387-oauth-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010972    6126 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d589edbb-387b-4a9f-8a8e-171a2fff06cf-console-oauth-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010981    6126 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d589edbb-387b-4a9f-8a8e-171a2fff06cf-tmp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010990    6126 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f699aea-caae-4dd7-a01d-edfaf2b23387-console-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.011025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.010998    6126 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d589edbb-387b-4a9f-8a8e-171a2fff06cf-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:35.650129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650085    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"d2aeadebaa60fcc073e2aabf9afcae8814c25ec0b998e45ea830b1231248f83e"}
Oct 30 23:07:35.650299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650148    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"48ba7cb37c3c63cafeb9d703a33aa6b86a1df17443140bae39c7219caf22e8f9"}
Oct 30 23:07:35.650299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650179    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"96ba20b21a9ea66c4320c4a127cd5a7c91a3c124de783667202f9aeb58cccb76"}
Oct 30 23:07:35.650299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650217    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"b57077e0ddb435c5ad24c52cf5022cea892d9f878bd68867327a9cad951c0fbd"}
Oct 30 23:07:35.650299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650246    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"6908cfa133cb01a0bb322ee4614717af5f7f3692f43ab1e14ca1d0eb7ea92d48"}
Oct 30 23:07:35.650299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.650270    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37cdb494-de14-49e2-a739-75537cb8c9ad","Type":"ContainerStarted","Data":"5aa0b9cf6269caa000a80d0fdc9f08864428dcdf7f4a09fd217584770c30247a"}
Oct 30 23:07:35.651454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.651429    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-996d7c98d-jbv7s" event={"ID":"d589edbb-387b-4a9f-8a8e-171a2fff06cf","Type":"ContainerDied","Data":"bffa711ec0d8ab13964d28e7f9394300166034913e6a0d8c48f55752734b9851"}
Oct 30 23:07:35.651567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.651476    6126 scope.go:122] "RemoveContainer" containerID="5108fd6fdb843e5c9649793812e40371837441ff21db3ad86cc13cd50416e0e2"
Oct 30 23:07:35.651567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.651434    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-996d7c98d-jbv7s"
Oct 30 23:07:35.653025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.653003    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689bbf5654-hrm8r" event={"ID":"0f699aea-caae-4dd7-a01d-edfaf2b23387","Type":"ContainerDied","Data":"edb7b659a6ece7cf1deb15039cea1aa431a53d8c4708eadcdcb6d9c5c31c7fc9"}
Oct 30 23:07:35.653025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.653032    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689bbf5654-hrm8r"
Oct 30 23:07:35.661523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.661395    6126 scope.go:122] "RemoveContainer" containerID="5b76150f6b9d06741b02bd8a027a194da9ae572e3452778f4c58c3de505a23ff"
Oct 30 23:07:35.777156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.777060    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.765970642 podStartE2EDuration="3.777045281s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.074639ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:35.776450848 +0000 UTC m=+27.536543420" watchObservedRunningTime="2026-10-30 23:07:35.777045281 +0000 UTC m=+27.537137848"
Oct 30 23:07:35.888814 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.888786    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:07:35.892181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:35.892158    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689bbf5654-hrm8r"]
Oct 30 23:07:36.002992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.002957    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-996d7c98d-jbv7s"]
Oct 30 23:07:36.007045 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.007020    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-996d7c98d-jbv7s"]
Oct 30 23:07:36.404216 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.404186    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f699aea-caae-4dd7-a01d-edfaf2b23387" path="/var/lib/kubelet/pods/0f699aea-caae-4dd7-a01d-edfaf2b23387/volumes"
Oct 30 23:07:36.404600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.404587    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" path="/var/lib/kubelet/pods/d589edbb-387b-4a9f-8a8e-171a2fff06cf/volumes"
Oct 30 23:07:36.414253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.414231    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:36.414323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.414285    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:36.419256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.419236    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:36.663093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.663014    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5845f8c79-2twqk"
Oct 30 23:07:36.819816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:36.819786    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9495d56b-dvsfw"]
Oct 30 23:07:37.278287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.278243    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279216    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-thanos" containerID="cri-o://06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7" gracePeriod=600
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279759    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-web" containerID="cri-o://7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6" gracePeriod=600
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279868    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy" containerID="cri-o://773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532" gracePeriod=600
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279879    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="thanos-sidecar" containerID="cri-o://ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e" gracePeriod=600
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279842    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="prometheus" containerID="cri-o://38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50" gracePeriod=600
Oct 30 23:07:37.280008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.279917    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="config-reloader" containerID="cri-o://4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d" gracePeriod=600
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667580    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7" exitCode=0
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667608    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532" exitCode=0
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667633    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6" exitCode=0
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667641    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e" exitCode=0
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667648    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d" exitCode=0
Oct 30 23:07:37.667691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667659    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"}
Oct 30 23:07:37.668101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667762    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"}
Oct 30 23:07:37.668101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667793    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"}
Oct 30 23:07:37.668101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667820    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"}
Oct 30 23:07:37.668101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:37.667844    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"}
Oct 30 23:07:39.563767 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:39.563717    6126 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 23:07:39.564176 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:39.563783    6126 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 23:07:39.564176 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:39.563800    6126 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Oct 30 23:07:39.564176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:39.563814    6126 prober.go:106] "Probe errored" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="prometheus" probeResult="unknown" err="rpc error: code = Canceled desc = context canceled"
Oct 30 23:07:41.416118 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:41.416085    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:41.419844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:41.419822    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dcddbd87f-zwc2x"
Oct 30 23:07:43.329114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.329086    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:43.491660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491605    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.491851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491687    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.491851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491705    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.491971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491868    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.491971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491949    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.491987    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492026    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492055    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492083    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492117    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492159    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.492224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492174    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492204    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492237    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492252    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492267    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492302    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492334    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492325    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492393    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492426    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492462    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:43.492472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492468    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492483    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492507    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") pod \"c57fb91a-da7c-45fb-b508-c104c4e623ab\" (UID: \"c57fb91a-da7c-45fb-b508-c104c4e623ab\") "
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492814    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492841    6126 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492860    6126 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-db\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492876    6126 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-metrics-client-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492893    6126 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.493015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.492908    6126 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.493699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.493422    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.494137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.493875    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:43.495823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.495751    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.496075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.496039    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:43.496159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.496082    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.496863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.496830    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.497419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.497393    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.497527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.497465    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "kube-api-access-zvv6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:43.497848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.497823    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.498067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.498037    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.498658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.498604    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:43.498802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.498778    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.498937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.498921    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.510066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.510042    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config" pod "c57fb91a-da7c-45fb-b508-c104c4e623ab" (UID: "c57fb91a-da7c-45fb-b508-c104c4e623ab"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:43.594285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594249    6126 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-grpc-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594281    6126 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594296    6126 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594310    6126 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-tls-assets\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594322    6126 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594334    6126 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594346    6126 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c57fb91a-da7c-45fb-b508-c104c4e623ab-config-out\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594360    6126 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594372    6126 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-metrics-client-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594384    6126 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594396    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvv6m\" (UniqueName: \"kubernetes.io/projected/c57fb91a-da7c-45fb-b508-c104c4e623ab-kube-api-access-zvv6m\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594408    6126 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594421    6126 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c57fb91a-da7c-45fb-b508-c104c4e623ab-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594433    6126 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-secret-kube-rbac-proxy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.594523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.594445    6126 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c57fb91a-da7c-45fb-b508-c104c4e623ab-web-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:43.696439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.696401    6126 generic.go:356] "Generic (PLEG): container finished" podID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50" exitCode=0
Oct 30 23:07:43.696596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.696462    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"}
Oct 30 23:07:43.696596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.696480    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:43.696596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.696520    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c57fb91a-da7c-45fb-b508-c104c4e623ab","Type":"ContainerDied","Data":"4fb0e049d1b5cd390784cced521ac4d496777139dc401c00f2cde7e1bdee0c78"}
Oct 30 23:07:43.696596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.696553    6126 scope.go:122] "RemoveContainer" containerID="06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"
Oct 30 23:07:43.705447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.705430    6126 scope.go:122] "RemoveContainer" containerID="773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"
Oct 30 23:07:43.712388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.712370    6126 scope.go:122] "RemoveContainer" containerID="7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"
Oct 30 23:07:43.719235 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.719221    6126 scope.go:122] "RemoveContainer" containerID="ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"
Oct 30 23:07:43.725991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.725974    6126 scope.go:122] "RemoveContainer" containerID="4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"
Oct 30 23:07:43.732812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.732796    6126 scope.go:122] "RemoveContainer" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"
Oct 30 23:07:43.740313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.740281    6126 scope.go:122] "RemoveContainer" containerID="2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d"
Oct 30 23:07:43.747133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747119    6126 scope.go:122] "RemoveContainer" containerID="06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"
Oct 30 23:07:43.747400 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.747384    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7\": container with ID starting with 06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7 not found: ID does not exist" containerID="06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"
Oct 30 23:07:43.747452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747409    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7"} err="failed to get container status \"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7\": rpc error: code = NotFound desc = could not find container \"06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7\": container with ID starting with 06b1a231cf67648985b250a371c823a1fd194c4e258f0058d8f9257e3f4db4c7 not found: ID does not exist"
Oct 30 23:07:43.747494 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747451    6126 scope.go:122] "RemoveContainer" containerID="773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"
Oct 30 23:07:43.747731 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.747713    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532\": container with ID starting with 773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532 not found: ID does not exist" containerID="773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"
Oct 30 23:07:43.747796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747738    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532"} err="failed to get container status \"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532\": rpc error: code = NotFound desc = could not find container \"773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532\": container with ID starting with 773a4b89b747a18838917a57f78aa9fb51074b19fd6e51783ebdcb31758cb532 not found: ID does not exist"
Oct 30 23:07:43.747796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747755    6126 scope.go:122] "RemoveContainer" containerID="7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"
Oct 30 23:07:43.747989 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.747973    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6\": container with ID starting with 7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6 not found: ID does not exist" containerID="7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"
Oct 30 23:07:43.748030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.747992    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6"} err="failed to get container status \"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6\": rpc error: code = NotFound desc = could not find container \"7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6\": container with ID starting with 7cd4c8c45e7f8cfc755e14add73037d87ddee38f877940694f57881a901220f6 not found: ID does not exist"
Oct 30 23:07:43.748030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748005    6126 scope.go:122] "RemoveContainer" containerID="ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"
Oct 30 23:07:43.748209 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.748193    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e\": container with ID starting with ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e not found: ID does not exist" containerID="ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"
Oct 30 23:07:43.748252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748212    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e"} err="failed to get container status \"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e\": rpc error: code = NotFound desc = could not find container \"ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e\": container with ID starting with ff3a96ed55fe3de4630c2e241a6d12ecdd3b0fe4df3574de52535953b8a1684e not found: ID does not exist"
Oct 30 23:07:43.748252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748222    6126 scope.go:122] "RemoveContainer" containerID="4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"
Oct 30 23:07:43.748407 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.748392    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d\": container with ID starting with 4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d not found: ID does not exist" containerID="4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"
Oct 30 23:07:43.748445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748409    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d"} err="failed to get container status \"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d\": rpc error: code = NotFound desc = could not find container \"4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d\": container with ID starting with 4edf80571c761ff120d63b417271cf64afcfb9a6e4f55c8875c6732ce7a7491d not found: ID does not exist"
Oct 30 23:07:43.748445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748420    6126 scope.go:122] "RemoveContainer" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"
Oct 30 23:07:43.748600 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.748586    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50\": container with ID starting with 38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50 not found: ID does not exist" containerID="38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"
Oct 30 23:07:43.748659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748602    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50"} err="failed to get container status \"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50\": rpc error: code = NotFound desc = could not find container \"38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50\": container with ID starting with 38f803e1bea23534cf39446dd152de0821a48391afd3f4e07317c10c52ec4e50 not found: ID does not exist"
Oct 30 23:07:43.748954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.748940    6126 scope.go:122] "RemoveContainer" containerID="2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d"
Oct 30 23:07:43.749180 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:43.749164    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d\": container with ID starting with 2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d not found: ID does not exist" containerID="2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d"
Oct 30 23:07:43.749233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.749186    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d"} err="failed to get container status \"2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d\": rpc error: code = NotFound desc = could not find container \"2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d\": container with ID starting with 2bb54244d976ac0d6a87c79dd6a71b23aa304b58ce9d7ec8761fec84e789d53d not found: ID does not exist"
Oct 30 23:07:43.873400 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.873367    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:43.882847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.882822    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:43.923842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.923810    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:43.924145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924133    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="config-reloader"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924148    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="config-reloader"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924159    6126 cpu_manager.go:414] "containerMap: removing container" podUID="0f699aea-caae-4dd7-a01d-edfaf2b23387" containerName="console"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924165    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f699aea-caae-4dd7-a01d-edfaf2b23387" containerName="console"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924180    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="prometheus"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924185    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="prometheus"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924192    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-thanos"
Oct 30 23:07:43.924200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924196    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-thanos"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924209    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="thanos-sidecar"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924214    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="thanos-sidecar"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924221    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-web"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924226    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-web"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924236    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="init-config-reloader"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924241    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="init-config-reloader"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924248    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" containerName="console"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924253    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" containerName="console"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924260    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924264    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924316    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924324    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d589edbb-387b-4a9f-8a8e-171a2fff06cf" containerName="console"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924333    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="config-reloader"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924338    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f699aea-caae-4dd7-a01d-edfaf2b23387" containerName="console"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924345    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="prometheus"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924349    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-thanos"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924355    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="thanos-sidecar"
Oct 30 23:07:43.924421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.924359    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" containerName="kube-rbac-proxy-web"
Oct 30 23:07:43.928098 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.928080    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:43.988154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988099    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 23:07:43.988154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988128    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 23:07:43.988154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988142    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 23:07:43.988424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988186    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 23:07:43.988424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988190    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 23:07:43.988424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988191    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tfc2b\""
Oct 30 23:07:43.988424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988403    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 23:07:43.988424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988411    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 23:07:43.988900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988477    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 23:07:43.988900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988535    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 23:07:43.988900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988539    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 23:07:43.988900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:43.988675    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4u7qa66bq4aih\""
Oct 30 23:07:44.033748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.033683    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 23:07:44.037081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.037063    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 23:07:44.037471 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.037451    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 23:07:44.037599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.037585    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 23:07:44.048026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.048003    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:44.098212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098185    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2ng\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-kube-api-access-jx2ng\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098215    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098236    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098252    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098306    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098335    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-config-out\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098398    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098458    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098527    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098545    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098567    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098585    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098678    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098703    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098720    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098796    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098813    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098834    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-web-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.098896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098881    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.099012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.098898    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199506    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199543    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199581    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199597    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199639    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-web-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199661    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199679    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199752    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2ng\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-kube-api-access-jx2ng\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199794    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199822    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199844    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199864    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199885    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-config-out\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199908    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.199951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199934    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199968    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.199995    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.200032    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.200064    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.200111    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.200252    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.200818 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.200453    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.201827 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.201257    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.201827 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.201537    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.202166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.202138    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.202375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.202347    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.203116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.202780    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.203557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.203293    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.203557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.203328    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.203557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.203513    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48d391a-95b3-480f-8a83-ade82f576158-config-out\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.204949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.204853    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-web-config\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.204949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.204881    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.205346 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.205328    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.205433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.205350    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.205479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.205440    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.205785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.205767    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a48d391a-95b3-480f-8a83-ade82f576158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.206013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.205988    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.206348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.206332    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.206791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.206769    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48d391a-95b3-480f-8a83-ade82f576158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.259358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.259326    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2ng\" (UniqueName: \"kubernetes.io/projected/a48d391a-95b3-480f-8a83-ade82f576158-kube-api-access-jx2ng\") pod \"prometheus-k8s-0\" (UID: \"a48d391a-95b3-480f-8a83-ade82f576158\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:44.403638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.403546    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c57fb91a-da7c-45fb-b508-c104c4e623ab" path="/var/lib/kubelet/pods/c57fb91a-da7c-45fb-b508-c104c4e623ab/volumes"
Oct 30 23:07:44.546762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:44.546717    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:07:45.026551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.026522    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 23:07:45.029628 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:07:45.029592    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48d391a_95b3_480f_8a83_ade82f576158.slice/crio-7a9234f5db51a97f4b59cb3fbe7457512cbfc91c8e470e826431ad309740b1e9 WatchSource:0}: Error finding container 7a9234f5db51a97f4b59cb3fbe7457512cbfc91c8e470e826431ad309740b1e9: Status 404 returned error can't find the container with id 7a9234f5db51a97f4b59cb3fbe7457512cbfc91c8e470e826431ad309740b1e9
Oct 30 23:07:45.226880 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.226849    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94xqm"
Oct 30 23:07:45.707066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.707031    6126 generic.go:356] "Generic (PLEG): container finished" podID="a48d391a-95b3-480f-8a83-ade82f576158" containerID="8a2da91e011d158955975020495c10f2e96df8f06c66807c6577c2ef48fd6176" exitCode=0
Oct 30 23:07:45.707523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.707086    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerDied","Data":"8a2da91e011d158955975020495c10f2e96df8f06c66807c6577c2ef48fd6176"}
Oct 30 23:07:45.707523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.707138    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"7a9234f5db51a97f4b59cb3fbe7457512cbfc91c8e470e826431ad309740b1e9"}
Oct 30 23:07:45.753347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:45.753265    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5bb4968b4d-mm6ms" podUID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" containerName="console" containerID="cri-o://be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1" gracePeriod=15
Oct 30 23:07:46.050780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.050756    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:46.218945 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.218919    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.218986    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219033    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219076    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219100    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219116    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219144    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") pod \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\" (UID: \"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8\") "
Oct 30 23:07:46.219375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219203    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:07:46.219434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219400    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:46.219485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219432    6126 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-tmp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.219534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.219512    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:46.220039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.220013    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:07:46.221566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.221541    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:46.221566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.221553    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "kube-api-access-hql9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:07:46.221727 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.221643    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert" pod "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" (UID: "3d0fc55f-ed29-4830-a0e2-8214ca25ecb8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:07:46.320132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320103    6126 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.320132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320130    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hql9m\" (UniqueName: \"kubernetes.io/projected/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-kube-api-access-hql9m\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.320336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320143    6126 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.320336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320152    6126 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-oauth-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.320336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320161    6126 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-oauth-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.320336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.320170    6126 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8-console-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:07:46.715085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.714982    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"5cf758acf0faea204828d3c77dd7fe7b488621a804ee8a1d8f3100b74ec3965b"}
Oct 30 23:07:46.715085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.715066    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"c9a9704302a533f8bf145bf9c8de9dc3a52fd5cf442dca213f440fd6e9dbc836"}
Oct 30 23:07:46.715574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.715107    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"e9b578dcf7b3a209f8598766af861e28f86022f9a552557bb0d2349cba61348d"}
Oct 30 23:07:46.715574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.715143    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"e14e299db6afbdf3f2fd14c34b5604372208bc2a5570b7a95c10fcc45f3a8c73"}
Oct 30 23:07:46.715574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.715175    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"5f490e3305493b316f369993ac74c0c6efaba4c2cfb2e9bd840732b4e9ebfa29"}
Oct 30 23:07:46.715574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.715211    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a48d391a-95b3-480f-8a83-ade82f576158","Type":"ContainerStarted","Data":"83827a95ca61914bbbbc277747f8ce5036f4d8d66a3f99921ce8781e9be5ff49"}
Oct 30 23:07:46.716154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.716120    6126 generic.go:356] "Generic (PLEG): container finished" podID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" containerID="be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1" exitCode=0
Oct 30 23:07:46.716275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.716177    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb4968b4d-mm6ms"
Oct 30 23:07:46.716275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.716199    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb4968b4d-mm6ms" event={"ID":"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8","Type":"ContainerDied","Data":"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"}
Oct 30 23:07:46.716275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.716244    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb4968b4d-mm6ms" event={"ID":"3d0fc55f-ed29-4830-a0e2-8214ca25ecb8","Type":"ContainerDied","Data":"d32f8421fbb25c12d695b17904102321cd032b058006e249ac1c685915dc1969"}
Oct 30 23:07:46.716275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.716265    6126 scope.go:122] "RemoveContainer" containerID="be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"
Oct 30 23:07:46.724457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.724435    6126 scope.go:122] "RemoveContainer" containerID="be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"
Oct 30 23:07:46.724773 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:07:46.724755    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1\": container with ID starting with be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1 not found: ID does not exist" containerID="be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"
Oct 30 23:07:46.724837 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.724779    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1"} err="failed to get container status \"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1\": rpc error: code = NotFound desc = could not find container \"be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1\": container with ID starting with be8c4a8dfd8ede169a89cd415490988394ebd3c6c90c357726194d4714c61aa1 not found: ID does not exist"
Oct 30 23:07:46.844277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.844226    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.828859874 podStartE2EDuration="3.844212146s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.352272ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:07:46.843544861 +0000 UTC m=+38.603637433" watchObservedRunningTime="2026-10-30 23:07:46.844212146 +0000 UTC m=+38.604304717"
Oct 30 23:07:46.955544 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.955513    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:07:46.959699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:46.959672    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bb4968b4d-mm6ms"]
Oct 30 23:07:48.404287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:48.404256    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" path="/var/lib/kubelet/pods/3d0fc55f-ed29-4830-a0e2-8214ca25ecb8/volumes"
Oct 30 23:07:49.547609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:07:49.547574    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:08:01.840942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:01.840882    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7c9495d56b-dvsfw" podUID="3febcfb0-7521-459f-9117-b41cd68c7150" containerName="console" containerID="cri-o://0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12" gracePeriod=15
Oct 30 23:08:02.095230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.095175    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:08:02.146496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146464    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146510    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146533    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146562    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\" (UniqueName: \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146598    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146674    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146728    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.146849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146753    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\") pod \"3febcfb0-7521-459f-9117-b41cd68c7150\" (UID: \"3febcfb0-7521-459f-9117-b41cd68c7150\") "
Oct 30 23:08:02.147070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.147038    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:08:02.147132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.147075    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:08:02.147288 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.147247    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:08:02.147487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.147303    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:08:02.147487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.146940    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:08:02.148916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.148885    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:08:02.149032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.149006    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "kube-api-access-7gb7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:08:02.149128 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.149095    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert" pod "3febcfb0-7521-459f-9117-b41cd68c7150" (UID: "3febcfb0-7521-459f-9117-b41cd68c7150"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:08:02.248482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248446    6126 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-oauth-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248478    6126 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3febcfb0-7521-459f-9117-b41cd68c7150-tmp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248487    6126 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-serving-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248497    6126 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-console-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248506    6126 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-trusted-ca-bundle\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248514    6126 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3febcfb0-7521-459f-9117-b41cd68c7150-console-oauth-config\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248522    6126 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3febcfb0-7521-459f-9117-b41cd68c7150-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.248738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.248530    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gb7l\" (UniqueName: \"kubernetes.io/projected/3febcfb0-7521-459f-9117-b41cd68c7150-kube-api-access-7gb7l\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:08:02.792338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.792309    6126 generic.go:356] "Generic (PLEG): container finished" podID="3febcfb0-7521-459f-9117-b41cd68c7150" containerID="0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12" exitCode=0
Oct 30 23:08:02.792498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.792374    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9495d56b-dvsfw"
Oct 30 23:08:02.792498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.792395    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9495d56b-dvsfw" event={"ID":"3febcfb0-7521-459f-9117-b41cd68c7150","Type":"ContainerDied","Data":"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"}
Oct 30 23:08:02.792498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.792441    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9495d56b-dvsfw" event={"ID":"3febcfb0-7521-459f-9117-b41cd68c7150","Type":"ContainerDied","Data":"57aeed18242409557cc240fe66c6ddb3fb87f2099e6f9bcea26c1f55a95f9ff8"}
Oct 30 23:08:02.792498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.792460    6126 scope.go:122] "RemoveContainer" containerID="0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"
Oct 30 23:08:02.800954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.800937    6126 scope.go:122] "RemoveContainer" containerID="0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"
Oct 30 23:08:02.801212 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:08:02.801193    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12\": container with ID starting with 0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12 not found: ID does not exist" containerID="0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"
Oct 30 23:08:02.801260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.801220    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12"} err="failed to get container status \"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12\": rpc error: code = NotFound desc = could not find container \"0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12\": container with ID starting with 0a1dd62757c6b3f900fe3d0e18996eb11610d9d7a1a5d7492c68023ead3ecd12 not found: ID does not exist"
Oct 30 23:08:02.959153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:02.959122    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9495d56b-dvsfw"]
Oct 30 23:08:03.009446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:03.009410    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c9495d56b-dvsfw"]
Oct 30 23:08:04.149845 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:08:04.149803    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:08:04.403676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:04.403595    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3febcfb0-7521-459f-9117-b41cd68c7150" path="/var/lib/kubelet/pods/3febcfb0-7521-459f-9117-b41cd68c7150/volumes"
Oct 30 23:08:34.149121 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:08:34.149082    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:08:35.152967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:35.152923    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:08:35.169245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:35.169221    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:08:35.937878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:08:35.937853    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 23:09:04.149190 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:09:04.149110    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:09:34.149406 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:09:34.149371    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:10:04.151230 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:10:04.151192    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:10:34.150814 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:10:34.150770    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:11:04.149571 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:11:04.149533    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:11:34.150070 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:11:34.150034    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:12:04.149442 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:12:04.149350    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:12:08.446791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:08.446762    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:12:08.450397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:08.450376    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:12:24.503714 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.503677    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"]
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504061    6126 cpu_manager.go:414] "containerMap: removing container" podUID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" containerName="console"
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504074    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" containerName="console"
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504084    6126 cpu_manager.go:414] "containerMap: removing container" podUID="3febcfb0-7521-459f-9117-b41cd68c7150" containerName="console"
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504089    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3febcfb0-7521-459f-9117-b41cd68c7150" containerName="console"
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504152    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d0fc55f-ed29-4830-a0e2-8214ca25ecb8" containerName="console"
Oct 30 23:12:24.504155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.504160    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="3febcfb0-7521-459f-9117-b41cd68c7150" containerName="console"
Oct 30 23:12:24.507260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.507242    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.630553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.630516    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 23:12:24.630754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.630562    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 23:12:24.631056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.631040    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 23:12:24.631056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.631043    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-zt2dv\""
Oct 30 23:12:24.632789 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.632775    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 23:12:24.632873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.632791    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 23:12:24.638522 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.638497    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"]
Oct 30 23:12:24.678573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678546    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w855\" (UniqueName: \"kubernetes.io/projected/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-kube-api-access-5w855\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.678720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678585    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-tmp\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.678768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678720    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-manifests\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.678768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678746    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-metrics-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.678832 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678773    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.678864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.678832    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.779868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779796    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-manifests\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.779868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779825    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-metrics-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.779868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779849    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.779868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779865    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.780201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779895    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w855\" (UniqueName: \"kubernetes.io/projected/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-kube-api-access-5w855\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.780201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.779917    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-tmp\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.780299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.780249    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-manifests\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.782559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.782525    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-metrics-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.782692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.782579    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.782742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.782700    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-tmp\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.783023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.783001    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:24.838672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:24.838638    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w855\" (UniqueName: \"kubernetes.io/projected/90e5c89e-b413-4124-aa8e-b8d0e18ae2ba-kube-api-access-5w855\") pod \"opendatahub-operator-controller-manager-5b8f94678b-kqb9z\" (UID: \"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:25.121825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:25.121745    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:25.671178 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:12:25.671129    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e5c89e_b413_4124_aa8e_b8d0e18ae2ba.slice/crio-ab5be315e69cfcd966d48a3c2bfb40874354d17961541985798033984457e5a4 WatchSource:0}: Error finding container ab5be315e69cfcd966d48a3c2bfb40874354d17961541985798033984457e5a4: Status 404 returned error can't find the container with id ab5be315e69cfcd966d48a3c2bfb40874354d17961541985798033984457e5a4
Oct 30 23:12:25.672893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:25.672875    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:12:25.718997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:25.718968    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"]
Oct 30 23:12:25.784069 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:25.784032    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z" event={"ID":"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba","Type":"ContainerStarted","Data":"ab5be315e69cfcd966d48a3c2bfb40874354d17961541985798033984457e5a4"}
Oct 30 23:12:29.803107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:29.803069    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z" event={"ID":"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba","Type":"ContainerStarted","Data":"e814a3516f674198461e3fb7c8f8b28894a98e82136d61de6c5dc77d74731cc2"}
Oct 30 23:12:30.808257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:30.808218    6126 generic.go:356] "Generic (PLEG): container finished" podID="90e5c89e-b413-4124-aa8e-b8d0e18ae2ba" containerID="e814a3516f674198461e3fb7c8f8b28894a98e82136d61de6c5dc77d74731cc2" exitCode=0
Oct 30 23:12:30.808674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:30.808302    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z" event={"ID":"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba","Type":"ContainerDied","Data":"e814a3516f674198461e3fb7c8f8b28894a98e82136d61de6c5dc77d74731cc2"}
Oct 30 23:12:31.814796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:31.814759    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z" event={"ID":"90e5c89e-b413-4124-aa8e-b8d0e18ae2ba","Type":"ContainerStarted","Data":"2f43e3cf533cfc9398cf950dceb4a645feb8730ced43405a8a45a4699378410f"}
Oct 30 23:12:31.815195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:31.814850    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:32.098980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:32.098926    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z" podStartSLOduration=3.163213447 podStartE2EDuration="8.098911223s" totalImagesPullingTime="4.45702219s" totalInitContainerRuntime="478.675586ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:32.098723985 +0000 UTC m=+323.858816567" watchObservedRunningTime="2026-10-30 23:12:32.098911223 +0000 UTC m=+323.859003775"
Oct 30 23:12:34.149360 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:12:34.149323    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:12:38.765657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.765604    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"]
Oct 30 23:12:38.773215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.773197    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:38.833709 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.833647    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"]
Oct 30 23:12:38.896262 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.896233    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wsp6m\""
Oct 30 23:12:38.897007 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.896993    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 23:12:38.897185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.897169    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 23:12:38.906535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.906513    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq2ml\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-kube-api-access-xq2ml\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:38.906656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:38.906544    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.007270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.007228    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq2ml\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-kube-api-access-xq2ml\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.007433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.007275    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.074756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.074680    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.075087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.075065    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq2ml\" (UniqueName: \"kubernetes.io/projected/29545a21-67dc-41b1-8e63-ad57b293f5e5-kube-api-access-xq2ml\") pod \"cert-manager-webhook-5dbbbf75cc-l2ltl\" (UID: \"29545a21-67dc-41b1-8e63-ad57b293f5e5\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.101911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.101884    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:39.491290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.491259    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"]
Oct 30 23:12:39.494479 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:12:39.494450    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29545a21_67dc_41b1_8e63_ad57b293f5e5.slice/crio-83cad83adbb666b5a7c8fe9b5f2e9ac7c87b5c88cef00c2742a8e1ed5e1a0991 WatchSource:0}: Error finding container 83cad83adbb666b5a7c8fe9b5f2e9ac7c87b5c88cef00c2742a8e1ed5e1a0991: Status 404 returned error can't find the container with id 83cad83adbb666b5a7c8fe9b5f2e9ac7c87b5c88cef00c2742a8e1ed5e1a0991
Oct 30 23:12:39.851805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:39.851725    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl" event={"ID":"29545a21-67dc-41b1-8e63-ad57b293f5e5","Type":"ContainerStarted","Data":"83cad83adbb666b5a7c8fe9b5f2e9ac7c87b5c88cef00c2742a8e1ed5e1a0991"}
Oct 30 23:12:42.822355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:42.822320    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5b8f94678b-kqb9z"
Oct 30 23:12:44.216668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.216573    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"]
Oct 30 23:12:44.218998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.218977    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.258867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.258843    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnb8t\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-kube-api-access-xnb8t\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.259009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.258903    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.289455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.289426    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"]
Oct 30 23:12:44.314952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.314880    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jdflv\""
Oct 30 23:12:44.360149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.360115    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.360304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.360176    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnb8t\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-kube-api-access-xnb8t\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.443651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.443608    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.443879 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.443859    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnb8t\" (UniqueName: \"kubernetes.io/projected/1627ed1e-6077-469e-99d6-dcd4debb5f27-kube-api-access-xnb8t\") pod \"cert-manager-cainjector-5c57bbd4fc-7tmsh\" (UID: \"1627ed1e-6077-469e-99d6-dcd4debb5f27\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.530014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.529983    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"
Oct 30 23:12:44.877059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.876958    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl" event={"ID":"29545a21-67dc-41b1-8e63-ad57b293f5e5","Type":"ContainerStarted","Data":"c0a900d7591224ff0685119bb91eca2f1da1104d0a2052e580c3800fe110d296"}
Oct 30 23:12:44.877059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.877014    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:44.910276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.910246    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh"]
Oct 30 23:12:44.914063 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:12:44.914039    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1627ed1e_6077_469e_99d6_dcd4debb5f27.slice/crio-9fbd740e5d45a787bd061ef55f4e3ca70334405eefb09a644395913ac6a9ae19 WatchSource:0}: Error finding container 9fbd740e5d45a787bd061ef55f4e3ca70334405eefb09a644395913ac6a9ae19: Status 404 returned error can't find the container with id 9fbd740e5d45a787bd061ef55f4e3ca70334405eefb09a644395913ac6a9ae19
Oct 30 23:12:44.994304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:44.994253    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl" podStartSLOduration=2.527587913 podStartE2EDuration="6.99423877s" totalImagesPullingTime="4.466650857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:44.992585584 +0000 UTC m=+336.752678166" watchObservedRunningTime="2026-10-30 23:12:44.99423877 +0000 UTC m=+336.754331342"
Oct 30 23:12:45.882747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:45.882709    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh" event={"ID":"1627ed1e-6077-469e-99d6-dcd4debb5f27","Type":"ContainerStarted","Data":"02b45ede5ecfcd35cdbed04be192f0feec206317359b7a2cb0f16123fdf0a979"}
Oct 30 23:12:45.883146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:45.882758    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh" event={"ID":"1627ed1e-6077-469e-99d6-dcd4debb5f27","Type":"ContainerStarted","Data":"9fbd740e5d45a787bd061ef55f4e3ca70334405eefb09a644395913ac6a9ae19"}
Oct 30 23:12:46.020225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:46.020174    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7tmsh" podStartSLOduration=2.020158058 podStartE2EDuration="2.020158058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:46.018730051 +0000 UTC m=+337.778822635" watchObservedRunningTime="2026-10-30 23:12:46.020158058 +0000 UTC m=+337.780250620"
Oct 30 23:12:48.948842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:48.948810    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"]
Oct 30 23:12:48.952298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:48.952261    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.002164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.002138    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68wx\" (UniqueName: \"kubernetes.io/projected/da1e7b57-f8fc-4252-885e-7674f5c5e1da-kube-api-access-v68wx\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.002342 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.002179    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da1e7b57-f8fc-4252-885e-7674f5c5e1da-tmp\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.057544 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.057508    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:12:49.057751 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.057557    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-xkz4q\""
Oct 30 23:12:49.057751 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.057576    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 23:12:49.058652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.058601    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"]
Oct 30 23:12:49.104477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.104442    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68wx\" (UniqueName: \"kubernetes.io/projected/da1e7b57-f8fc-4252-885e-7674f5c5e1da-kube-api-access-v68wx\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.104685 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.104511    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da1e7b57-f8fc-4252-885e-7674f5c5e1da-tmp\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.104935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.104914    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da1e7b57-f8fc-4252-885e-7674f5c5e1da-tmp\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.186279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.186247    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68wx\" (UniqueName: \"kubernetes.io/projected/da1e7b57-f8fc-4252-885e-7674f5c5e1da-kube-api-access-v68wx\") pod \"jobset-operator-674cd59dc5-c6tmf\" (UID: \"da1e7b57-f8fc-4252-885e-7674f5c5e1da\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.277923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.277890    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"
Oct 30 23:12:49.321033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.321001    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-5k7vl"]
Oct 30 23:12:49.324443 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.324418    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.379311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.379286    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-j4pj9\""
Oct 30 23:12:49.385352 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.385330    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-5k7vl"]
Oct 30 23:12:49.407853 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.407830    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-bound-sa-token\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.407982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.407861    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzmj\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-kube-api-access-4mzmj\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.508860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.508829    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-bound-sa-token\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.508860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.508864    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzmj\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-kube-api-access-4mzmj\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.598999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.598935    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-bound-sa-token\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.598999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.598996    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzmj\" (UniqueName: \"kubernetes.io/projected/f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c-kube-api-access-4mzmj\") pod \"cert-manager-597b95cb84-5k7vl\" (UID: \"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c\") " pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.639710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.639686    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-5k7vl"
Oct 30 23:12:49.670461 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.670403    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf"]
Oct 30 23:12:49.673226 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:12:49.673191    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda1e7b57_f8fc_4252_885e_7674f5c5e1da.slice/crio-a766805d4e2f5c77b86f4a2d8af6319f2d8eb83b1212e2880457b2d7920e2b31 WatchSource:0}: Error finding container a766805d4e2f5c77b86f4a2d8af6319f2d8eb83b1212e2880457b2d7920e2b31: Status 404 returned error can't find the container with id a766805d4e2f5c77b86f4a2d8af6319f2d8eb83b1212e2880457b2d7920e2b31
Oct 30 23:12:49.900936 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:49.900866    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf" event={"ID":"da1e7b57-f8fc-4252-885e-7674f5c5e1da","Type":"ContainerStarted","Data":"a766805d4e2f5c77b86f4a2d8af6319f2d8eb83b1212e2880457b2d7920e2b31"}
Oct 30 23:12:50.031572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:50.031537    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-5k7vl"]
Oct 30 23:12:50.034684 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:12:50.034658    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8ef7cd1_2b48_4c14_8cd5_16ae3a2be71c.slice/crio-255134afd9d6985ba3c117b525f3991757e8bdafbfda4c691418b6cdab708fde WatchSource:0}: Error finding container 255134afd9d6985ba3c117b525f3991757e8bdafbfda4c691418b6cdab708fde: Status 404 returned error can't find the container with id 255134afd9d6985ba3c117b525f3991757e8bdafbfda4c691418b6cdab708fde
Oct 30 23:12:50.885600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:50.885571    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-l2ltl"
Oct 30 23:12:50.906294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:50.906264    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-5k7vl" event={"ID":"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c","Type":"ContainerStarted","Data":"7498e33fadade8e7141e153098b874e512dea40092d298b4bfdc728a09db1ef1"}
Oct 30 23:12:50.906427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:50.906302    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-5k7vl" event={"ID":"f8ef7cd1-2b48-4c14-8cd5-16ae3a2be71c","Type":"ContainerStarted","Data":"255134afd9d6985ba3c117b525f3991757e8bdafbfda4c691418b6cdab708fde"}
Oct 30 23:12:51.143678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:51.143559    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-5k7vl" podStartSLOduration=2.143546424 podStartE2EDuration="2.143546424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:51.142675486 +0000 UTC m=+342.902768056" watchObservedRunningTime="2026-10-30 23:12:51.143546424 +0000 UTC m=+342.903638995"
Oct 30 23:12:53.923769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:53.923684    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf" event={"ID":"da1e7b57-f8fc-4252-885e-7674f5c5e1da","Type":"ContainerStarted","Data":"52cfe037d0b0835b76a3dd65aa12df3bd09dab0ab2365dba981703bbd922df95"}
Oct 30 23:12:54.053050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:12:54.052998    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c6tmf" podStartSLOduration=2.239749782 podStartE2EDuration="6.052983385s" totalImagesPullingTime="3.813233603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:54.051384791 +0000 UTC m=+345.811477362" watchObservedRunningTime="2026-10-30 23:12:54.052983385 +0000 UTC m=+345.813075955"
Oct 30 23:13:01.277641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.271392    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"]
Oct 30 23:13:01.294066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.294015    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.335837 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.335803    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"]
Oct 30 23:13:01.350172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.350144    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 23:13:01.350347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.350213    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 23:13:01.385096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.385070    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 23:13:01.385253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.385165    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 23:13:01.385253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.385174    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xq6np\""
Oct 30 23:13:01.422301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.422272    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15b730c-ea62-4f64-8518-6834c439a0a0-tmp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.422469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.422337    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pqp\" (UniqueName: \"kubernetes.io/projected/e15b730c-ea62-4f64-8518-6834c439a0a0-kube-api-access-59pqp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.422469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.422435    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e15b730c-ea62-4f64-8518-6834c439a0a0-tls-certs\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.523568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.523533    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15b730c-ea62-4f64-8518-6834c439a0a0-tmp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.523776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.523684    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59pqp\" (UniqueName: \"kubernetes.io/projected/e15b730c-ea62-4f64-8518-6834c439a0a0-kube-api-access-59pqp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.523776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.523719    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e15b730c-ea62-4f64-8518-6834c439a0a0-tls-certs\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.526042 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.526015    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15b730c-ea62-4f64-8518-6834c439a0a0-tmp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.526278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.526256    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e15b730c-ea62-4f64-8518-6834c439a0a0-tls-certs\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.583962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.583889    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pqp\" (UniqueName: \"kubernetes.io/projected/e15b730c-ea62-4f64-8518-6834c439a0a0-kube-api-access-59pqp\") pod \"kube-auth-proxy-bd9cf9d49-b4brk\" (UID: \"e15b730c-ea62-4f64-8518-6834c439a0a0\") " pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.608706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.608677    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"
Oct 30 23:13:01.989525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:01.989493    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk"]
Oct 30 23:13:01.994814 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:13:01.994792    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15b730c_ea62_4f64_8518_6834c439a0a0.slice/crio-ec3f7873973e3b2d8aa1981383a4e894a252cf8ca7c5b4eb83205c65b178a0bc WatchSource:0}: Error finding container ec3f7873973e3b2d8aa1981383a4e894a252cf8ca7c5b4eb83205c65b178a0bc: Status 404 returned error can't find the container with id ec3f7873973e3b2d8aa1981383a4e894a252cf8ca7c5b4eb83205c65b178a0bc
Oct 30 23:13:02.963908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:02.963869    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk" event={"ID":"e15b730c-ea62-4f64-8518-6834c439a0a0","Type":"ContainerStarted","Data":"ec3f7873973e3b2d8aa1981383a4e894a252cf8ca7c5b4eb83205c65b178a0bc"}
Oct 30 23:13:04.152738 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:13:04.152695    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:13:04.978588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:04.978550    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk" event={"ID":"e15b730c-ea62-4f64-8518-6834c439a0a0","Type":"ContainerStarted","Data":"edbdcd26cebd13d20eed5b600b38e0f18ae0ae217c943ff054bd92618590509b"}
Oct 30 23:13:05.095517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:05.095459    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bd9cf9d49-b4brk" podStartSLOduration=1.219678379 podStartE2EDuration="4.095442484s" totalImagesPullingTime="2.875764105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:13:05.094088974 +0000 UTC m=+356.854181545" watchObservedRunningTime="2026-10-30 23:13:05.095442484 +0000 UTC m=+356.855535101"
Oct 30 23:13:08.490750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.490716    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:08.495729 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.495709    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.550960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.550926    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-62hmr\""
Oct 30 23:13:08.595707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.595675    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.595840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.595797    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktv2q\" (UniqueName: \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.601606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.601586    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 23:13:08.601753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.601635    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 23:13:08.601753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.601647    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 23:13:08.602713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.602695    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:08.696812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.696779    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktv2q\" (UniqueName: \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.696986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.696864    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.697527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.697510    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.733076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.733044    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:08.755320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.755253    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktv2q\" (UniqueName: \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\") pod \"limitador-limitador-74dfcfb894-wnnl9\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:08.808047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:08.808014    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:09.182386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:09.182302    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:09.185247 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:13:09.185221    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643a4d6f_2782_4aed_9989_2938597790d1.slice/crio-0c4689eedcced5b3702b85a96cdf95544ccabc95675f514b320c16b7b397e23b WatchSource:0}: Error finding container 0c4689eedcced5b3702b85a96cdf95544ccabc95675f514b320c16b7b397e23b: Status 404 returned error can't find the container with id 0c4689eedcced5b3702b85a96cdf95544ccabc95675f514b320c16b7b397e23b
Oct 30 23:13:10.003039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:10.003001    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" event={"ID":"643a4d6f-2782-4aed-9989-2938597790d1","Type":"ContainerStarted","Data":"0c4689eedcced5b3702b85a96cdf95544ccabc95675f514b320c16b7b397e23b"}
Oct 30 23:13:11.603498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.603465    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 30 23:13:11.606952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.606934    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.660310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.660285    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rsddc\""
Oct 30 23:13:11.711728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.711699    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 30 23:13:11.734567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.734539    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wqz\" (UniqueName: \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.734732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.734700    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.835836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.835432    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.835836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.835526    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wqz\" (UniqueName: \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.836030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.835863    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.897569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.897500    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wqz\" (UniqueName: \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\") pod \"kuadrant-operator-controller-manager-678d87766f-slwlx\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:11.920282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:11.920254    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:12.358366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:12.358343    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 30 23:13:12.361304 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:13:12.361277    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ad46d6_92af_48ab_acdf_197895d555ec.slice/crio-57fbf63c41556f07ed73af47a963f0345c38e6c4fcde8cb2afb856f759e816ae WatchSource:0}: Error finding container 57fbf63c41556f07ed73af47a963f0345c38e6c4fcde8cb2afb856f759e816ae: Status 404 returned error can't find the container with id 57fbf63c41556f07ed73af47a963f0345c38e6c4fcde8cb2afb856f759e816ae
Oct 30 23:13:13.027348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:13.027220    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" event={"ID":"47ad46d6-92af-48ab-acdf-197895d555ec","Type":"ContainerStarted","Data":"57fbf63c41556f07ed73af47a963f0345c38e6c4fcde8cb2afb856f759e816ae"}
Oct 30 23:13:14.035011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:14.034976    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" event={"ID":"643a4d6f-2782-4aed-9989-2938597790d1","Type":"ContainerStarted","Data":"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"}
Oct 30 23:13:14.035448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:14.035098    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:14.154730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:14.154665    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" podStartSLOduration=1.925945249 podStartE2EDuration="6.154645103s" totalImagesPullingTime="4.228699854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:13:14.154041358 +0000 UTC m=+365.914133929" watchObservedRunningTime="2026-10-30 23:13:14.154645103 +0000 UTC m=+365.914737677"
Oct 30 23:13:18.056481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:18.056445    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" event={"ID":"47ad46d6-92af-48ab-acdf-197895d555ec","Type":"ContainerStarted","Data":"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"}
Oct 30 23:13:18.056961 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:18.056545    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:18.276574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:18.276520    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" podStartSLOduration=2.640433256 podStartE2EDuration="7.276503347s" totalImagesPullingTime="4.636070091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:13:18.225877875 +0000 UTC m=+369.985970445" watchObservedRunningTime="2026-10-30 23:13:18.276503347 +0000 UTC m=+370.036595918"
Oct 30 23:13:25.041484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:25.041453    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:28.047830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.047798    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"]
Oct 30 23:13:28.060036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.060006    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.087078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.087049    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11ff1ce3-0442-47e8-8da7-f38df20493bf-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.087227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.087109    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6469d\" (UniqueName: \"kubernetes.io/projected/11ff1ce3-0442-47e8-8da7-f38df20493bf-kube-api-access-6469d\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.087227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.087186    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.087335 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.087259    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.114061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.114031    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 23:13:28.114061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.114049    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 23:13:28.188240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188207    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.188389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188257    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11ff1ce3-0442-47e8-8da7-f38df20493bf-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.188389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188309    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6469d\" (UniqueName: \"kubernetes.io/projected/11ff1ce3-0442-47e8-8da7-f38df20493bf-kube-api-access-6469d\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.188389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188326    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.188696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188674    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.188743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.188682    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ff1ce3-0442-47e8-8da7-f38df20493bf-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.215412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.215380    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-vrjfk\""
Oct 30 23:13:28.266564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.266530    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 23:13:28.267733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.267710    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"]
Oct 30 23:13:28.269339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.269319    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6469d\" (UniqueName: \"kubernetes.io/projected/11ff1ce3-0442-47e8-8da7-f38df20493bf-kube-api-access-6469d\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.269536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.269514    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11ff1ce3-0442-47e8-8da7-f38df20493bf-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zwhz5\" (UID: \"11ff1ce3-0442-47e8-8da7-f38df20493bf\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.374426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.374344    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:28.499253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.499223    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:28.499432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.499406    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" podUID="643a4d6f-2782-4aed-9989-2938597790d1" containerName="limitador" containerID="cri-o://2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7" gracePeriod=30
Oct 30 23:13:28.795840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:28.795810    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"]
Oct 30 23:13:28.799156 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:13:28.799127    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ff1ce3_0442_47e8_8da7_f38df20493bf.slice/crio-f7cb8e82803cfd4acdf4ecd3a9ed5cfae4ed08190a98a539e81f016d03c64b6d WatchSource:0}: Error finding container f7cb8e82803cfd4acdf4ecd3a9ed5cfae4ed08190a98a539e81f016d03c64b6d: Status 404 returned error can't find the container with id f7cb8e82803cfd4acdf4ecd3a9ed5cfae4ed08190a98a539e81f016d03c64b6d
Oct 30 23:13:29.033564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.033541    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:29.063245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.063217    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 30 23:13:29.120612 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.120582    6126 generic.go:356] "Generic (PLEG): container finished" podID="643a4d6f-2782-4aed-9989-2938597790d1" containerID="2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7" exitCode=0
Oct 30 23:13:29.120800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.120636    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"
Oct 30 23:13:29.120800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.120658    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" event={"ID":"643a4d6f-2782-4aed-9989-2938597790d1","Type":"ContainerDied","Data":"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"}
Oct 30 23:13:29.120800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.120711    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-wnnl9" event={"ID":"643a4d6f-2782-4aed-9989-2938597790d1","Type":"ContainerDied","Data":"0c4689eedcced5b3702b85a96cdf95544ccabc95675f514b320c16b7b397e23b"}
Oct 30 23:13:29.120800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.120745    6126 scope.go:122] "RemoveContainer" containerID="2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"
Oct 30 23:13:29.121896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.121878    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5" event={"ID":"11ff1ce3-0442-47e8-8da7-f38df20493bf","Type":"ContainerStarted","Data":"f7cb8e82803cfd4acdf4ecd3a9ed5cfae4ed08190a98a539e81f016d03c64b6d"}
Oct 30 23:13:29.128863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.128846    6126 scope.go:122] "RemoveContainer" containerID="2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"
Oct 30 23:13:29.129161 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:13:29.129142    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7\": container with ID starting with 2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7 not found: ID does not exist" containerID="2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"
Oct 30 23:13:29.129211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.129169    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7"} err="failed to get container status \"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7\": rpc error: code = NotFound desc = could not find container \"2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7\": container with ID starting with 2ca2ed63f68e7e05f33636272c15558e833c263baafc82a7514b5a8f4702efd7 not found: ID does not exist"
Oct 30 23:13:29.195883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.195849    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\" (UniqueName: \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\") pod \"643a4d6f-2782-4aed-9989-2938597790d1\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") "
Oct 30 23:13:29.196039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.195933    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\" (UniqueName: \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\") pod \"643a4d6f-2782-4aed-9989-2938597790d1\" (UID: \"643a4d6f-2782-4aed-9989-2938597790d1\") "
Oct 30 23:13:29.196317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.196298    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file" pod "643a4d6f-2782-4aed-9989-2938597790d1" (UID: "643a4d6f-2782-4aed-9989-2938597790d1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:13:29.198161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.198137    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q" pod "643a4d6f-2782-4aed-9989-2938597790d1" (UID: "643a4d6f-2782-4aed-9989-2938597790d1"). InnerVolumeSpecName "kube-api-access-ktv2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:13:29.297184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.297151    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktv2q\" (UniqueName: \"kubernetes.io/projected/643a4d6f-2782-4aed-9989-2938597790d1-kube-api-access-ktv2q\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:13:29.297325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.297191    6126 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643a4d6f-2782-4aed-9989-2938597790d1-config-file\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:13:29.544241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.544153    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:29.545754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:29.545730    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-wnnl9"]
Oct 30 23:13:30.405636 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:30.405548    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="643a4d6f-2782-4aed-9989-2938597790d1" path="/var/lib/kubelet/pods/643a4d6f-2782-4aed-9989-2938597790d1/volumes"
Oct 30 23:13:31.133372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:31.133338    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5" event={"ID":"11ff1ce3-0442-47e8-8da7-f38df20493bf","Type":"ContainerStarted","Data":"0fd8b9a26ab04a9a30099a613a7020e47a93e463bf17175511b339bf59fd7e2c"}
Oct 30 23:13:31.133553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:31.133506    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:13:31.316816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:31.316763    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5" podStartSLOduration=1.435743287 podStartE2EDuration="3.316744695s" totalImagesPullingTime="1.881001408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:13:31.316146276 +0000 UTC m=+383.076238848" watchObservedRunningTime="2026-10-30 23:13:31.316744695 +0000 UTC m=+383.076837266"
Oct 30 23:13:34.150097 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:13:34.150065    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:13:52.138219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:13:52.138189    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zwhz5"
Oct 30 23:14:04.149230 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:14:04.149191    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:14:34.152192 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:14:34.152157    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:14:34.784888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.784853    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2t6l6"]
Oct 30 23:14:34.785286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.785272    6126 cpu_manager.go:414] "containerMap: removing container" podUID="643a4d6f-2782-4aed-9989-2938597790d1" containerName="limitador"
Oct 30 23:14:34.785342 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.785287    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="643a4d6f-2782-4aed-9989-2938597790d1" containerName="limitador"
Oct 30 23:14:34.785381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.785351    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="643a4d6f-2782-4aed-9989-2938597790d1" containerName="limitador"
Oct 30 23:14:34.792024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.792005    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:34.898241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.898208    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fbx4z\""
Oct 30 23:14:34.898241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.898222    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 23:14:34.899756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.899736    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2t6l6"]
Oct 30 23:14:34.905015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.904992    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6w2\" (UniqueName: \"kubernetes.io/projected/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-kube-api-access-nb6w2\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:34.905138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:34.905048    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-cert\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.006517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.006474    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6w2\" (UniqueName: \"kubernetes.io/projected/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-kube-api-access-nb6w2\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.006712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.006559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-cert\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.009440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.009411    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-cert\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.067610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.067543    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6w2\" (UniqueName: \"kubernetes.io/projected/78b79eb4-f7a2-4464-a9fb-e2a32c1596be-kube-api-access-nb6w2\") pod \"kserve-controller-manager-776cc66d47-2t6l6\" (UID: \"78b79eb4-f7a2-4464-a9fb-e2a32c1596be\") " pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.104268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.104236    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:35.183034 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.183006    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-l4fk5"]
Oct 30 23:14:35.186557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.186541    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.244412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.244383    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 23:14:35.244645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.244450    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 23:14:35.244645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.244508    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8q8hz\""
Oct 30 23:14:35.258637 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.258590    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-l4fk5"]
Oct 30 23:14:35.309532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.309504    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-metrics-certs\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.309726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.309567    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-cert\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.309726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.309709    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nksl7\" (UniqueName: \"kubernetes.io/projected/558f28f0-3880-4c97-823c-f1d8f9b21f14-kube-api-access-nksl7\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.411286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.411220    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-cert\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.411286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.411260    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nksl7\" (UniqueName: \"kubernetes.io/projected/558f28f0-3880-4c97-823c-f1d8f9b21f14-kube-api-access-nksl7\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.411457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.411318    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-metrics-certs\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.413886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.413856    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-cert\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.414003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.413910    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558f28f0-3880-4c97-823c-f1d8f9b21f14-metrics-certs\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.473088 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.473059    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nksl7\" (UniqueName: \"kubernetes.io/projected/558f28f0-3880-4c97-823c-f1d8f9b21f14-kube-api-access-nksl7\") pod \"odh-model-controller-769875db56-l4fk5\" (UID: \"558f28f0-3880-4c97-823c-f1d8f9b21f14\") " pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.479116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.479090    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-2t6l6"]
Oct 30 23:14:35.482029 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:14:35.482005    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b79eb4_f7a2_4464_a9fb_e2a32c1596be.slice/crio-8592faafe3d839a25e6eb2bbdee8d971f7ed04c45163a9deede08651544e1efc WatchSource:0}: Error finding container 8592faafe3d839a25e6eb2bbdee8d971f7ed04c45163a9deede08651544e1efc: Status 404 returned error can't find the container with id 8592faafe3d839a25e6eb2bbdee8d971f7ed04c45163a9deede08651544e1efc
Oct 30 23:14:35.500767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.500748    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:35.902481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:35.902439    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-l4fk5"]
Oct 30 23:14:35.906544 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:14:35.906519    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558f28f0_3880_4c97_823c_f1d8f9b21f14.slice/crio-96893dc021c196c7d52349fddb608447a1a6cf7ca83a97f12c868e3c0375da90 WatchSource:0}: Error finding container 96893dc021c196c7d52349fddb608447a1a6cf7ca83a97f12c868e3c0375da90: Status 404 returned error can't find the container with id 96893dc021c196c7d52349fddb608447a1a6cf7ca83a97f12c868e3c0375da90
Oct 30 23:14:36.436860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:36.436826    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-l4fk5" event={"ID":"558f28f0-3880-4c97-823c-f1d8f9b21f14","Type":"ContainerStarted","Data":"96893dc021c196c7d52349fddb608447a1a6cf7ca83a97f12c868e3c0375da90"}
Oct 30 23:14:36.438101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:36.438083    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6" event={"ID":"78b79eb4-f7a2-4464-a9fb-e2a32c1596be","Type":"ContainerStarted","Data":"8592faafe3d839a25e6eb2bbdee8d971f7ed04c45163a9deede08651544e1efc"}
Oct 30 23:14:39.460899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:39.460865    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-l4fk5" event={"ID":"558f28f0-3880-4c97-823c-f1d8f9b21f14","Type":"ContainerStarted","Data":"4c1a0383cce21844c55095dad874e755616d29ba45642c6848a74d35992aef97"}
Oct 30 23:14:39.461356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:39.460938    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:39.462431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:39.462407    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6" event={"ID":"78b79eb4-f7a2-4464-a9fb-e2a32c1596be","Type":"ContainerStarted","Data":"2ec3a3e0cbd439f5e4a3a20001a60f3f095ef7fe212261d20dd71043c430e72b"}
Oct 30 23:14:39.462526 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:39.462458    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:14:39.706433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:39.706334    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-l4fk5" podStartSLOduration=1.3792329589999999 podStartE2EDuration="4.706320471s" totalImagesPullingTime="3.327087512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:14:39.584328102 +0000 UTC m=+451.344420674" watchObservedRunningTime="2026-10-30 23:14:39.706320471 +0000 UTC m=+451.466413084"
Oct 30 23:14:50.468410 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:50.468332    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-l4fk5"
Oct 30 23:14:50.593115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:14:50.593052    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6" podStartSLOduration=13.684714426 podStartE2EDuration="16.593038369s" totalImagesPullingTime="2.908323943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:14:39.705665699 +0000 UTC m=+451.465758285" watchObservedRunningTime="2026-10-30 23:14:50.593038369 +0000 UTC m=+462.353130940"
Oct 30 23:15:01.308686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.308651    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:01.313414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.313395    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.362337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.362306    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.362482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.362350    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.362524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.362486    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsjp\" (UniqueName: \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.362571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.362552    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.367404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.367389    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 23:15:01.418392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.418359    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 23:15:01.418577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.418539    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 23:15:01.418680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.418578    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s5prt\""
Oct 30 23:15:01.418680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.418599    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 23:15:01.419866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.419846    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:01.463110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.463076    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.463394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.463374    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsjp\" (UniqueName: \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.463499 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.463411    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.463559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.463521    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.463858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.463835    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.466001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.465981    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.466092 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.465987    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.530731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.530693    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsjp\" (UniqueName: \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\") pod \"maas-api-6d669c7fcd-v5cgh\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.624593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.624517    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:01.996161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:01.996127    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:01.999112 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:15:01.999084    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8108b94_0280_4e4d_ab1b_244e7b827e1d.slice/crio-85baf055df33087afdbf19dcaa87c7bee60afaf66b75132babdeaf805223190d WatchSource:0}: Error finding container 85baf055df33087afdbf19dcaa87c7bee60afaf66b75132babdeaf805223190d: Status 404 returned error can't find the container with id 85baf055df33087afdbf19dcaa87c7bee60afaf66b75132babdeaf805223190d
Oct 30 23:15:02.579411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:02.579378    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" event={"ID":"b8108b94-0280-4e4d-ab1b-244e7b827e1d","Type":"ContainerStarted","Data":"85baf055df33087afdbf19dcaa87c7bee60afaf66b75132babdeaf805223190d"}
Oct 30 23:15:04.152559 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:15:04.152521    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:15:05.596586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:05.596551    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" event={"ID":"b8108b94-0280-4e4d-ab1b-244e7b827e1d","Type":"ContainerStarted","Data":"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"}
Oct 30 23:15:05.597030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:05.596675    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:05.719463 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:05.719410    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" podStartSLOduration=1.781624711 podStartE2EDuration="4.719388849s" totalImagesPullingTime="2.937764138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:15:05.71805512 +0000 UTC m=+477.478147692" watchObservedRunningTime="2026-10-30 23:15:05.719388849 +0000 UTC m=+477.479481414"
Oct 30 23:15:10.471275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:10.471242    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-2t6l6"
Oct 30 23:15:11.606757 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:11.606727    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:12.593039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.593001    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 30 23:15:12.596021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.595999    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.664808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.664776    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 30 23:15:12.675647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.675600    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.675809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.675722    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.675853 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.675800    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.675887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.675870    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdl82\" (UniqueName: \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.777159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.777120    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdl82\" (UniqueName: \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.777337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.777221    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.777337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.777257    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.777337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.777278    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.777991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.777960    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.779958 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.779936    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.780045 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.779975    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.845379 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.845306    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdl82\" (UniqueName: \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\") pod \"maas-api-84b8bf64d7-mb2g9\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") " pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:12.908330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:12.908295    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:13.290242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:13.290216    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 30 23:15:13.292668 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:15:13.292635    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca1e799_3b61_4931_bebb_17513a8edd0e.slice/crio-a814e1c4cbfd8bea8adf04d0351b857334f24ac2d3c9f82052f874e2599792ea WatchSource:0}: Error finding container a814e1c4cbfd8bea8adf04d0351b857334f24ac2d3c9f82052f874e2599792ea: Status 404 returned error can't find the container with id a814e1c4cbfd8bea8adf04d0351b857334f24ac2d3c9f82052f874e2599792ea
Oct 30 23:15:13.635752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:13.635665    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" event={"ID":"0ca1e799-3b61-4931-bebb-17513a8edd0e","Type":"ContainerStarted","Data":"a814e1c4cbfd8bea8adf04d0351b857334f24ac2d3c9f82052f874e2599792ea"}
Oct 30 23:15:14.646948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:14.646906    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" event={"ID":"0ca1e799-3b61-4931-bebb-17513a8edd0e","Type":"ContainerStarted","Data":"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"}
Oct 30 23:15:14.775237 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:14.775177    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" podStartSLOduration=1.960317759 podStartE2EDuration="2.775161954s" totalImagesPullingTime="814.844195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:15:14.774875356 +0000 UTC m=+486.534967927" watchObservedRunningTime="2026-10-30 23:15:14.775161954 +0000 UTC m=+486.535254524"
Oct 30 23:15:15.651779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:15.651747    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:21.661850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:21.661822    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 30 23:15:21.830953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:21.830918    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:21.831185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:21.831137    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" podUID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" containerName="maas-api" containerID="cri-o://f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717" gracePeriod=30
Oct 30 23:15:22.078691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.078668    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:22.171942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.171911    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\" (UniqueName: \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\") pod \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") "
Oct 30 23:15:22.172141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.171955    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\") pod \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") "
Oct 30 23:15:22.172141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.171978    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\") pod \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") "
Oct 30 23:15:22.172141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.172026    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\") pod \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\" (UID: \"b8108b94-0280-4e4d-ab1b-244e7b827e1d\") "
Oct 30 23:15:22.172339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.172315    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca" pod "b8108b94-0280-4e4d-ab1b-244e7b827e1d" (UID: "b8108b94-0280-4e4d-ab1b-244e7b827e1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:15:22.174321 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.174295    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp" pod "b8108b94-0280-4e4d-ab1b-244e7b827e1d" (UID: "b8108b94-0280-4e4d-ab1b-244e7b827e1d"). InnerVolumeSpecName "kube-api-access-qlsjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:15:22.174456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.174320    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls" pod "b8108b94-0280-4e4d-ab1b-244e7b827e1d" (UID: "b8108b94-0280-4e4d-ab1b-244e7b827e1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:15:22.174456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.174346    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs" pod "b8108b94-0280-4e4d-ab1b-244e7b827e1d" (UID: "b8108b94-0280-4e4d-ab1b-244e7b827e1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:15:22.272913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.272875    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlsjp\" (UniqueName: \"kubernetes.io/projected/b8108b94-0280-4e4d-ab1b-244e7b827e1d-kube-api-access-qlsjp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:15:22.272913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.272909    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8108b94-0280-4e4d-ab1b-244e7b827e1d-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:15:22.272913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.272920    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:15:22.273168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.272930    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8108b94-0280-4e4d-ab1b-244e7b827e1d-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:15:22.686420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.686325    6126 generic.go:356] "Generic (PLEG): container finished" podID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" containerID="f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717" exitCode=0
Oct 30 23:15:22.686420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.686380    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"
Oct 30 23:15:22.686420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.686404    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" event={"ID":"b8108b94-0280-4e4d-ab1b-244e7b827e1d","Type":"ContainerDied","Data":"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"}
Oct 30 23:15:22.686931 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.686460    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh" event={"ID":"b8108b94-0280-4e4d-ab1b-244e7b827e1d","Type":"ContainerDied","Data":"85baf055df33087afdbf19dcaa87c7bee60afaf66b75132babdeaf805223190d"}
Oct 30 23:15:22.686931 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.686483    6126 scope.go:122] "RemoveContainer" containerID="f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"
Oct 30 23:15:22.695306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.695281    6126 scope.go:122] "RemoveContainer" containerID="f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"
Oct 30 23:15:22.695658 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:15:22.695638    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717\": container with ID starting with f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717 not found: ID does not exist" containerID="f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"
Oct 30 23:15:22.695712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.695672    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717"} err="failed to get container status \"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717\": rpc error: code = NotFound desc = could not find container \"f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717\": container with ID starting with f62d41fa6debd7afb152b4b8b7a035470e6c016fd2f8bc928c091602d59e1717 not found: ID does not exist"
Oct 30 23:15:22.853066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.853024    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:22.903907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:22.903874    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-v5cgh"]
Oct 30 23:15:24.405412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:15:24.405383    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" path="/var/lib/kubelet/pods/b8108b94-0280-4e4d-ab1b-244e7b827e1d/volumes"
Oct 30 23:15:34.149378 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:15:34.149336    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:16:04.149443 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:16:04.149396    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:16:34.150473 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:16:34.150436    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:16:52.669226 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.669193    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"]
Oct 30 23:16:52.669696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.669588    6126 cpu_manager.go:414] "containerMap: removing container" podUID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" containerName="maas-api"
Oct 30 23:16:52.669696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.669598    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" containerName="maas-api"
Oct 30 23:16:52.669773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.669723    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8108b94-0280-4e4d-ab1b-244e7b827e1d" containerName="maas-api"
Oct 30 23:16:52.672755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.672739    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.778562 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.778536    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 23:16:52.778562 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.778536    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fzxnc\""
Oct 30 23:16:52.778818 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.778802    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 23:16:52.779003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.778986    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 23:16:52.780235 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.780218    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"]
Oct 30 23:16:52.827914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.827885    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.827914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.827915    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.828107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.828089    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.828156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.828138    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.828231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.828217    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkngk\" (UniqueName: \"kubernetes.io/projected/5b9b407f-c259-48fd-b0bd-dfa6af481475-kube-api-access-rkngk\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.828270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.828250    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9b407f-c259-48fd-b0bd-dfa6af481475-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929017    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkngk\" (UniqueName: \"kubernetes.io/projected/5b9b407f-c259-48fd-b0bd-dfa6af481475-kube-api-access-rkngk\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929060    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9b407f-c259-48fd-b0bd-dfa6af481475-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929100    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929129    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929224    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929263    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929586    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929672    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.929863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.929842    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.931899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.931873    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9b407f-c259-48fd-b0bd-dfa6af481475-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.932000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.931876    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9b407f-c259-48fd-b0bd-dfa6af481475-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:52.987567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:52.987527    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkngk\" (UniqueName: \"kubernetes.io/projected/5b9b407f-c259-48fd-b0bd-dfa6af481475-kube-api-access-rkngk\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm\" (UID: \"5b9b407f-c259-48fd-b0bd-dfa6af481475\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:53.285694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:53.285653    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:53.661428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:53.661402    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"]
Oct 30 23:16:53.663958 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:16:53.663931    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9b407f_c259_48fd_b0bd_dfa6af481475.slice/crio-30e4c89e7a9f0b815ef0a7eeaa73a029f43a0266907a8c9bea8d180daf40c44b WatchSource:0}: Error finding container 30e4c89e7a9f0b815ef0a7eeaa73a029f43a0266907a8c9bea8d180daf40c44b: Status 404 returned error can't find the container with id 30e4c89e7a9f0b815ef0a7eeaa73a029f43a0266907a8c9bea8d180daf40c44b
Oct 30 23:16:54.110478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:54.110440    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm" event={"ID":"5b9b407f-c259-48fd-b0bd-dfa6af481475","Type":"ContainerStarted","Data":"30e4c89e7a9f0b815ef0a7eeaa73a029f43a0266907a8c9bea8d180daf40c44b"}
Oct 30 23:16:56.122758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.122669    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm" event={"ID":"5b9b407f-c259-48fd-b0bd-dfa6af481475","Type":"ContainerStarted","Data":"d42fea7d0941cbbed24afa8d1ee2ec1637772478765552075f001ecd26564e7b"}
Oct 30 23:16:56.169160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.169129    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"]
Oct 30 23:16:56.173004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.172985    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.225932 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.225907    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 23:16:56.231428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.231398    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"]
Oct 30 23:16:56.264795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.264766    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f67f360-db37-4061-83e9-d95856cd2252-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.264952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.264801    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.264952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.264885    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7xbc\" (UniqueName: \"kubernetes.io/projected/9f67f360-db37-4061-83e9-d95856cd2252-kube-api-access-q7xbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.264952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.264938    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.265129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.265014    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.265129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.265067    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.283158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.283111    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm" podStartSLOduration=2.095865801 podStartE2EDuration="4.283098669s" totalImagesPullingTime="2.187232868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:16:56.282380997 +0000 UTC m=+588.042473561" watchObservedRunningTime="2026-10-30 23:16:56.283098669 +0000 UTC m=+588.043191239"
Oct 30 23:16:56.286686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.286670    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:16:56.365882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.365857    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.365923    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7xbc\" (UniqueName: \"kubernetes.io/projected/9f67f360-db37-4061-83e9-d95856cd2252-kube-api-access-q7xbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.365966    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366004    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366178 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366041    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366178 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366106    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f67f360-db37-4061-83e9-d95856cd2252-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366394    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366441    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.366478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.366468    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.368580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.368555    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f67f360-db37-4061-83e9-d95856cd2252-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.368740 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.368724    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f67f360-db37-4061-83e9-d95856cd2252-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.424561 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.424495    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7xbc\" (UniqueName: \"kubernetes.io/projected/9f67f360-db37-4061-83e9-d95856cd2252-kube-api-access-q7xbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl\" (UID: \"9f67f360-db37-4061-83e9-d95856cd2252\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.485433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.485404    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:16:56.857503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:56.857471    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"]
Oct 30 23:16:56.860036 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:16:56.860002    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f67f360_db37_4061_83e9_d95856cd2252.slice/crio-ce8b72dc4a3d2bc38b0027a421f77e78a1bf181f1a41c67fd0e42eab4b769301 WatchSource:0}: Error finding container ce8b72dc4a3d2bc38b0027a421f77e78a1bf181f1a41c67fd0e42eab4b769301: Status 404 returned error can't find the container with id ce8b72dc4a3d2bc38b0027a421f77e78a1bf181f1a41c67fd0e42eab4b769301
Oct 30 23:16:57.128225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:57.128142    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl" event={"ID":"9f67f360-db37-4061-83e9-d95856cd2252","Type":"ContainerStarted","Data":"ce8b72dc4a3d2bc38b0027a421f77e78a1bf181f1a41c67fd0e42eab4b769301"}
Oct 30 23:16:58.134577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:58.134542    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl" event={"ID":"9f67f360-db37-4061-83e9-d95856cd2252","Type":"ContainerStarted","Data":"44a235d822d1296d72d04aa940c2e5c4a5df40e0f9b445431d63829f24d3f11e"}
Oct 30 23:16:58.255246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:58.255196    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl" podStartSLOduration=1.649230167 podStartE2EDuration="2.255180837s" totalImagesPullingTime="605.95067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:16:58.253713751 +0000 UTC m=+590.013806322" watchObservedRunningTime="2026-10-30 23:16:58.255180837 +0000 UTC m=+590.015273402"
Oct 30 23:16:58.486388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:16:58.486361    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:17:03.095483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.095445    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"]
Oct 30 23:17:03.099287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.099267    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.135731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.135699    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.135927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.135754    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.135927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.135884    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.136053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.135930    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9qm\" (UniqueName: \"kubernetes.io/projected/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-kube-api-access-5p9qm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.136053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.135955    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.136053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.136041    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.174375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.174339    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 30 23:17:03.205934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.205907    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"]
Oct 30 23:17:03.236975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.236930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.236985    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237031    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237060    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9qm\" (UniqueName: \"kubernetes.io/projected/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-kube-api-access-5p9qm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237085    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237180    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237397    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237474    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.237567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.237547    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.239550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.239532    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.239664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.239647    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.286769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.286734    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:17:03.299420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.299394    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:17:03.299605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.299587    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9qm\" (UniqueName: \"kubernetes.io/projected/2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541-kube-api-access-5p9qm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98\" (UID: \"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.412513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.412426    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:03.787549 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:03.787502    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"]
Oct 30 23:17:03.790038 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:03.790012    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5cd83c_bf2a_469f_b2d3_a4dd93ff9541.slice/crio-02bfbe1b566eb0cb14fe1ff4099d1212838f2636b0c756a6efdc008ce4719b36 WatchSource:0}: Error finding container 02bfbe1b566eb0cb14fe1ff4099d1212838f2636b0c756a6efdc008ce4719b36: Status 404 returned error can't find the container with id 02bfbe1b566eb0cb14fe1ff4099d1212838f2636b0c756a6efdc008ce4719b36
Oct 30 23:17:04.150594 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:17:04.150512    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:17:04.171542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:04.171511    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98" event={"ID":"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541","Type":"ContainerStarted","Data":"02bfbe1b566eb0cb14fe1ff4099d1212838f2636b0c756a6efdc008ce4719b36"}
Oct 30 23:17:04.182703 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:04.182683    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm"
Oct 30 23:17:05.182881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:05.182843    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98" event={"ID":"2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541","Type":"ContainerStarted","Data":"c59e09a234aa13b25cc4306148589f1b5a90f9111a94c6e1072d4985823b82fc"}
Oct 30 23:17:05.302268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:05.302213    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98" podStartSLOduration=1.727765928 podStartE2EDuration="2.302198148s" totalImagesPullingTime="574.43222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:05.301008665 +0000 UTC m=+597.061101234" watchObservedRunningTime="2026-10-30 23:17:05.302198148 +0000 UTC m=+597.062290718"
Oct 30 23:17:05.413072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:05.413037    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:06.485674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:06.485643    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:17:06.498176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:06.498149    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:17:07.204236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:07.204210    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl"
Oct 30 23:17:08.481079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:08.481054    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:17:08.481845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:08.481824    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:17:13.413429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.413388    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:13.426203 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.426175    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:13.595850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.595817    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"]
Oct 30 23:17:13.599715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.599700    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.658070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.658038    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 23:17:13.660790 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.660764    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"]
Oct 30 23:17:13.744286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744254    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47f2\" (UniqueName: \"kubernetes.io/projected/08cdd497-eb0a-4992-a697-4645a9730e07-kube-api-access-c47f2\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.744460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744311    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cdd497-eb0a-4992-a697-4645a9730e07-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.744460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744421    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.744460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744452    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.744558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744506    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.744558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.744552    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845264    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845338    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47f2\" (UniqueName: \"kubernetes.io/projected/08cdd497-eb0a-4992-a697-4645a9730e07-kube-api-access-c47f2\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845384    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cdd497-eb0a-4992-a697-4645a9730e07-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845437    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845470    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845505    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845817    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845866    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.845980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.845911    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.847689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.847673    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cdd497-eb0a-4992-a697-4645a9730e07-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.847969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.847954    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cdd497-eb0a-4992-a697-4645a9730e07-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.903369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.903339    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47f2\" (UniqueName: \"kubernetes.io/projected/08cdd497-eb0a-4992-a697-4645a9730e07-kube-api-access-c47f2\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9sngd\" (UID: \"08cdd497-eb0a-4992-a697-4645a9730e07\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:13.912222 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:13.912197    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:14.239488 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:14.239458    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98"
Oct 30 23:17:14.284361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:14.284251    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"]
Oct 30 23:17:14.287077 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:14.287050    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cdd497_eb0a_4992_a697_4645a9730e07.slice/crio-fd8ada47ce35ae074de613a9d0b34a2fe919edbb6bd48505f4204d651879fd04 WatchSource:0}: Error finding container fd8ada47ce35ae074de613a9d0b34a2fe919edbb6bd48505f4204d651879fd04: Status 404 returned error can't find the container with id fd8ada47ce35ae074de613a9d0b34a2fe919edbb6bd48505f4204d651879fd04
Oct 30 23:17:15.234939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:15.234902    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd" event={"ID":"08cdd497-eb0a-4992-a697-4645a9730e07","Type":"ContainerStarted","Data":"e2b2b921f59634866145740b2aa2a6c766cb14d56b41c41c5188e3d004a38948"}
Oct 30 23:17:15.235438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:15.234963    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd" event={"ID":"08cdd497-eb0a-4992-a697-4645a9730e07","Type":"ContainerStarted","Data":"fd8ada47ce35ae074de613a9d0b34a2fe919edbb6bd48505f4204d651879fd04"}
Oct 30 23:17:15.352909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:15.352858    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd" podStartSLOduration=1.782297279 podStartE2EDuration="2.35284427s" totalImagesPullingTime="570.546991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:15.351315678 +0000 UTC m=+607.111408248" watchObservedRunningTime="2026-10-30 23:17:15.35284427 +0000 UTC m=+607.112936835"
Oct 30 23:17:15.913184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:15.913148    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:20.482430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.482400    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"]
Oct 30 23:17:20.486168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.486150    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.592800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.592765    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 23:17:20.594168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.594148    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"]
Oct 30 23:17:20.614170 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614144    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfj6\" (UniqueName: \"kubernetes.io/projected/1b737fd3-97c2-4405-8875-9b198e94df4a-kube-api-access-gwfj6\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.614317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614216    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.614317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614295    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.614390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614378    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.614433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614420    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b737fd3-97c2-4405-8875-9b198e94df4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.614490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.614479    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715178    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715223    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715260    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715293    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b737fd3-97c2-4405-8875-9b198e94df4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715314    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715339    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfj6\" (UniqueName: \"kubernetes.io/projected/1b737fd3-97c2-4405-8875-9b198e94df4a-kube-api-access-gwfj6\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715679    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715731    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.715813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.715790    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.717798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.717775    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b737fd3-97c2-4405-8875-9b198e94df4a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.717958 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.717940    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b737fd3-97c2-4405-8875-9b198e94df4a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.773298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.773234    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfj6\" (UniqueName: \"kubernetes.io/projected/1b737fd3-97c2-4405-8875-9b198e94df4a-kube-api-access-gwfj6\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-nhl75\" (UID: \"1b737fd3-97c2-4405-8875-9b198e94df4a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:20.798150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:20.798123    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:21.177133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:21.177087    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"]
Oct 30 23:17:21.179800 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:21.179770    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b737fd3_97c2_4405_8875_9b198e94df4a.slice/crio-e6e46e14191628703ebf56f272e6b1a27ed644071d38988e6bd5af8222de45fa WatchSource:0}: Error finding container e6e46e14191628703ebf56f272e6b1a27ed644071d38988e6bd5af8222de45fa: Status 404 returned error can't find the container with id e6e46e14191628703ebf56f272e6b1a27ed644071d38988e6bd5af8222de45fa
Oct 30 23:17:21.265791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:21.265750    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75" event={"ID":"1b737fd3-97c2-4405-8875-9b198e94df4a","Type":"ContainerStarted","Data":"e6e46e14191628703ebf56f272e6b1a27ed644071d38988e6bd5af8222de45fa"}
Oct 30 23:17:22.272907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.272870    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75" event={"ID":"1b737fd3-97c2-4405-8875-9b198e94df4a","Type":"ContainerStarted","Data":"3dca54fe87f034b40ddb1a0dfb3d1346567d579d3a4e1f7f2709285daa7eb155"}
Oct 30 23:17:22.378438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.378406    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"]
Oct 30 23:17:22.382177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.382161    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.395667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.395608    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75" podStartSLOduration=1.818750207 podStartE2EDuration="2.395595161s" totalImagesPullingTime="576.844954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:22.389375674 +0000 UTC m=+614.149468244" watchObservedRunningTime="2026-10-30 23:17:22.395595161 +0000 UTC m=+614.155687753"
Oct 30 23:17:22.440902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.440865    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"]
Oct 30 23:17:22.446679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.446656    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 23:17:22.482324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.482298    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l8k5z\""
Oct 30 23:17:22.536139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536069    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536101    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536119    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7hr\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-kube-api-access-8d7hr\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536137    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536291    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536325    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536436    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536483    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.536524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.536499    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638189    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638287    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638317    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638389    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638417    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638447    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7hr\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-kube-api-access-8d7hr\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638475    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638536    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.638659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.638578    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.639336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.639312    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.639476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.639380    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.639560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.639498    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.639560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.639396    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.639823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.639804    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.641467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.641439    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.641673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.641649    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.697424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.697393    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7hr\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-kube-api-access-8d7hr\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.697424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.697416    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025d9e91-ef8a-47fa-a680-3ef99f6931c5-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-75r4c\" (UID: \"025d9e91-ef8a-47fa-a680-3ef99f6931c5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:22.798771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.798695    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:22.995521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:22.995490    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:23.423826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:23.423802    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"]
Oct 30 23:17:23.426635 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:23.426594    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025d9e91_ef8a_47fa_a680_3ef99f6931c5.slice/crio-5bd58d7fc5cbb8b7cd6edb14abc38cb4206c8c06c3575f09116ed0dffdf5b754 WatchSource:0}: Error finding container 5bd58d7fc5cbb8b7cd6edb14abc38cb4206c8c06c3575f09116ed0dffdf5b754: Status 404 returned error can't find the container with id 5bd58d7fc5cbb8b7cd6edb14abc38cb4206c8c06c3575f09116ed0dffdf5b754
Oct 30 23:17:23.912871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:23.912836    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:23.925881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:23.925854    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:24.283698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:24.283656    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" event={"ID":"025d9e91-ef8a-47fa-a680-3ef99f6931c5","Type":"ContainerStarted","Data":"5bd58d7fc5cbb8b7cd6edb14abc38cb4206c8c06c3575f09116ed0dffdf5b754"}
Oct 30 23:17:24.295768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:24.295742    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd"
Oct 30 23:17:27.568794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:27.568762    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:17:27.569036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:27.568831    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:17:27.569036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:27.568866    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:17:28.314583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:28.314544    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" event={"ID":"025d9e91-ef8a-47fa-a680-3ef99f6931c5","Type":"ContainerStarted","Data":"60ac22df14baaeb750cbb0ea275756b7da7f6183c9d0bc8a64aec61828afd3bf"}
Oct 30 23:17:28.999046 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:28.999015    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:29.003753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:29.003719    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:29.004262 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:29.003963    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:29.996638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:29.996033    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:29.996638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:29.996095    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:30.800643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:30.800287    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:30.818633 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:30.818592    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:30.939064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:30.939009    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podStartSLOduration=4.8000054290000005 podStartE2EDuration="8.938994282s" totalImagesPullingTime="4.138988853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:28.503973435 +0000 UTC m=+620.264066008" watchObservedRunningTime="2026-10-30 23:17:30.938994282 +0000 UTC m=+622.699086868"
Oct 30 23:17:30.996026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:30.995992    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:30.996291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:30.996262    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:31.348660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:31.348631    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-nhl75"
Oct 30 23:17:32.001643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:32.000063    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:32.001643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:32.000138    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:32.998641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:32.998005    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:32.998641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:32.998067    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:33.996888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:33.996850    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:33.997389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:33.996921    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:34.150409 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:17:34.150374    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:17:34.996577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:34.996534    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Oct 30 23:17:34.996805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:34.996680    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Oct 30 23:17:36.000725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:36.000688    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:36.001119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:36.000975    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:36.001752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:36.001724    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c"
Oct 30 23:17:44.332912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.332874    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"]
Oct 30 23:17:44.338712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.338690    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.394560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.394527    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"]
Oct 30 23:17:44.442085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.442024    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 23:17:44.442284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.442112    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vrv82\""
Oct 30 23:17:44.462289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.462249    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zzqj\" (UniqueName: \"kubernetes.io/projected/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-kube-api-access-2zzqj\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.462468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.462304    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.494378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.494304    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"]
Oct 30 23:17:44.498375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.498351    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.543343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.543309    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"]
Oct 30 23:17:44.563764 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.563723    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zzqj\" (UniqueName: \"kubernetes.io/projected/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-kube-api-access-2zzqj\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.563956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.563782    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2vrk\" (UniqueName: \"kubernetes.io/projected/89296a50-177e-485c-b1c3-4a7551984d90-kube-api-access-c2vrk\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.563956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.563848    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.564070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.564005    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89296a50-177e-485c-b1c3-4a7551984d90-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.565245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.565222    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.621350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.621274    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zzqj\" (UniqueName: \"kubernetes.io/projected/50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb-kube-api-access-2zzqj\") pod \"payload-pre-processing-7b98bb678c-f82lh\" (UID: \"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.653080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.653055    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:44.664848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.664698    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89296a50-177e-485c-b1c3-4a7551984d90-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.664848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.664764    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2vrk\" (UniqueName: \"kubernetes.io/projected/89296a50-177e-485c-b1c3-4a7551984d90-kube-api-access-c2vrk\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.665416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.665396    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89296a50-177e-485c-b1c3-4a7551984d90-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.725686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.723765    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2vrk\" (UniqueName: \"kubernetes.io/projected/89296a50-177e-485c-b1c3-4a7551984d90-kube-api-access-c2vrk\") pod \"payload-processing-55fbbbf9dc-ntr8w\" (UID: \"89296a50-177e-485c-b1c3-4a7551984d90\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:44.812965 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:44.812929    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:45.032886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:45.032832    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"]
Oct 30 23:17:45.035156 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:45.035128    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50879613_3ffe_45d0_ba4b_1a9bfbf8ebcb.slice/crio-0d944810406f3e94ff1bf25a1fdef3b5b2688603cf01cebc0422fea757c6a835 WatchSource:0}: Error finding container 0d944810406f3e94ff1bf25a1fdef3b5b2688603cf01cebc0422fea757c6a835: Status 404 returned error can't find the container with id 0d944810406f3e94ff1bf25a1fdef3b5b2688603cf01cebc0422fea757c6a835
Oct 30 23:17:45.037169 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:45.037149    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:17:45.189540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:45.189517    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"]
Oct 30 23:17:45.192348 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:45.192316    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89296a50_177e_485c_b1c3_4a7551984d90.slice/crio-09e0f970986773793110dcb8c0197b223038530fca9397369a4457faf07fc586 WatchSource:0}: Error finding container 09e0f970986773793110dcb8c0197b223038530fca9397369a4457faf07fc586: Status 404 returned error can't find the container with id 09e0f970986773793110dcb8c0197b223038530fca9397369a4457faf07fc586
Oct 30 23:17:45.410746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:45.410651    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh" event={"ID":"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb","Type":"ContainerStarted","Data":"0d944810406f3e94ff1bf25a1fdef3b5b2688603cf01cebc0422fea757c6a835"}
Oct 30 23:17:45.412132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:45.412104    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w" event={"ID":"89296a50-177e-485c-b1c3-4a7551984d90","Type":"ContainerStarted","Data":"09e0f970986773793110dcb8c0197b223038530fca9397369a4457faf07fc586"}
Oct 30 23:17:48.438837 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.438789    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w" event={"ID":"89296a50-177e-485c-b1c3-4a7551984d90","Type":"ContainerStarted","Data":"c488cc63d99193a4039decca36263ae74d13fb523f0696f94fb405f9ed585670"}
Oct 30 23:17:48.439277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.438872    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:48.440262 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.440235    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh" event={"ID":"50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb","Type":"ContainerStarted","Data":"ced71f27a9be1cd45c90acdb650327a468cf782041198abd7f68c2d2858c497f"}
Oct 30 23:17:48.440378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.440369    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:17:48.556682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.556520    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w" podStartSLOduration=1.486033307 podStartE2EDuration="4.556501501s" totalImagesPullingTime="3.070468194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:48.554943826 +0000 UTC m=+640.315036397" watchObservedRunningTime="2026-10-30 23:17:48.556501501 +0000 UTC m=+640.316594074"
Oct 30 23:17:48.672897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:48.672826    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh" podStartSLOduration=1.4789341280000001 podStartE2EDuration="4.672808667s" totalImagesPullingTime="3.193874539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:48.671156801 +0000 UTC m=+640.431249373" watchObservedRunningTime="2026-10-30 23:17:48.672808667 +0000 UTC m=+640.432901286"
Oct 30 23:17:52.894393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:52.894355    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"]
Oct 30 23:17:52.898246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:52.898220    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:52.954435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:52.954408    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"]
Oct 30 23:17:53.002684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.002654    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 23:17:53.002842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.002731    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-jckcl\""
Oct 30 23:17:53.002842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.002765    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 23:17:53.048942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.048906    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvwb\" (UniqueName: \"kubernetes.io/projected/6f0adc7e-dab8-42ae-a782-bc626a786068-kube-api-access-tzvwb\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.049120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.049101    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f0adc7e-dab8-42ae-a782-bc626a786068-metrics-certs\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.150383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.150301    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f0adc7e-dab8-42ae-a782-bc626a786068-metrics-certs\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.150383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.150369    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvwb\" (UniqueName: \"kubernetes.io/projected/6f0adc7e-dab8-42ae-a782-bc626a786068-kube-api-access-tzvwb\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.152858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.152830    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f0adc7e-dab8-42ae-a782-bc626a786068-metrics-certs\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.208608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.208572    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvwb\" (UniqueName: \"kubernetes.io/projected/6f0adc7e-dab8-42ae-a782-bc626a786068-kube-api-access-tzvwb\") pod \"ai-gateway-controller-7d9cf87f9b-rm5mx\" (UID: \"6f0adc7e-dab8-42ae-a782-bc626a786068\") " pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.212263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.212242    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:53.584134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:53.584097    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"]
Oct 30 23:17:53.586516 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:17:53.586489    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0adc7e_dab8_42ae_a782_bc626a786068.slice/crio-bb46ef851c686dee4d7b8b8a8204c7c12c18f485427bc9f37673a79f00d1ed37 WatchSource:0}: Error finding container bb46ef851c686dee4d7b8b8a8204c7c12c18f485427bc9f37673a79f00d1ed37: Status 404 returned error can't find the container with id bb46ef851c686dee4d7b8b8a8204c7c12c18f485427bc9f37673a79f00d1ed37
Oct 30 23:17:54.471322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:54.471285    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx" event={"ID":"6f0adc7e-dab8-42ae-a782-bc626a786068","Type":"ContainerStarted","Data":"bb46ef851c686dee4d7b8b8a8204c7c12c18f485427bc9f37673a79f00d1ed37"}
Oct 30 23:17:56.483073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:56.483025    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx" event={"ID":"6f0adc7e-dab8-42ae-a782-bc626a786068","Type":"ContainerStarted","Data":"9fb22572dd837fdfb03df20687f24846b4f44f98b552cfda8d150a34b92ff4af"}
Oct 30 23:17:56.483528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:56.483197    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:17:56.602013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:56.601963    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx" podStartSLOduration=2.264633678 podStartE2EDuration="4.601949643s" totalImagesPullingTime="2.337315965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:17:56.600011534 +0000 UTC m=+648.360104107" watchObservedRunningTime="2026-10-30 23:17:56.601949643 +0000 UTC m=+648.362042214"
Oct 30 23:17:59.448714 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:59.448679    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-ntr8w"
Oct 30 23:17:59.449137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:17:59.448764    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh"
Oct 30 23:18:04.150773 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:04.150731    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:18:07.490056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:07.490023    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7d9cf87f9b-rm5mx"
Oct 30 23:18:34.149389 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:34.149348    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:18:38.254358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.254320    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:18:38.262061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.262042    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.315289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.315255    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-057303-openshift-default-dockercfg-gz47w\""
Oct 30 23:18:38.367602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.367572    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:18:38.412897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.412820    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4d9\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.413289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413188    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.413289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413258    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.413604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413557    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.414057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413739    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.414057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413855    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.414057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413916    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.414057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.413957    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.414057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.414007    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515316    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515356    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515383    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515413    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4d9\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515453    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515468    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515497    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515529    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515600    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515830    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515865    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.515975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515941    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.516067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.515970    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.516274 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.516257    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.517954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.517933    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.518191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.518171    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.580075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.580043    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.580236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.580146    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4d9\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\") pod \"e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") " pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:38.874890 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:38.874802    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:39.205854 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.205782    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:18:39.210144 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.210124    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.270103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.270063    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:18:39.283826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.283794    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2cfb80-openshift-default-dockercfg-zk28c\""
Oct 30 23:18:39.325248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325212    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325251    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325282    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325372    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325401    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325424    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325463    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325645    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxkwr\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.325716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.325681    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.357554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.357524    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:18:39.359316 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:39.359284    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed281f6_ea15_42b1_92cf_989b908b8135.slice/crio-a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2 WatchSource:0}: Error finding container a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2: Status 404 returned error can't find the container with id a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2
Oct 30 23:18:39.361756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.361721    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:39.361855 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.361796    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:39.361855 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.361845    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:39.427041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427009    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427055    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427091    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427116    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427143    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427181    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427362    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxkwr\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427414    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427442    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427518    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.427889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427859    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.428146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427889    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.428146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.427929    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.428407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.428382    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.429916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.429898    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.430015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.429941    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.484952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.484919    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.484952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.484939    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxkwr\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.524116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.524084    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:39.528018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.527986    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:18:39.534507 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.534483    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.591661 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.588783    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-989a4f-openshift-default-dockercfg-qv7mz\""
Oct 30 23:18:39.591661 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.590602    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:18:39.630497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630464    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.630644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630605    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.630715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630696    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.630761 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630744    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.630881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630855    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.630941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630925    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.631012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.630995    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq9sc\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.631050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.631036    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.631094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.631076    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.702900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.702860    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerStarted","Data":"6f761952cb5c0785aa295cc26019674ab2c31620a7aeb55fd7214427ce9e3b85"}
Oct 30 23:18:39.703075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.702933    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerStarted","Data":"a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2"}
Oct 30 23:18:39.732579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.732544    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.732750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.732684    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.732750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.732721    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.732949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.732930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq9sc\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.732993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.732979    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733128 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733104    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733205    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733260    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733430    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733479    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733521    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733545    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733609    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.733777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.733759    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.735075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.735021    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.735728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.735709    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.790471 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.790436    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.790656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.790549    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq9sc\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.820331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.820281    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podStartSLOduration=1.820267387 podStartE2EDuration="1.820267387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:39.818871247 +0000 UTC m=+691.578963815" watchObservedRunningTime="2026-10-30 23:18:39.820267387 +0000 UTC m=+691.580359957"
Oct 30 23:18:39.875373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.875341    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:39.878579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.878555    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:39.933885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.933809    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:18:39.936669 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:39.936595    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa686b8_53b9_4b48_a3eb_66f2f78d9be6.slice/crio-b6c3bc69e4e6a5bb08d881c258243f4f33a70f31c8dda3599db11c3ab221e96b WatchSource:0}: Error finding container b6c3bc69e4e6a5bb08d881c258243f4f33a70f31c8dda3599db11c3ab221e96b: Status 404 returned error can't find the container with id b6c3bc69e4e6a5bb08d881c258243f4f33a70f31c8dda3599db11c3ab221e96b
Oct 30 23:18:39.940041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.940000    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:39.940138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.940092    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:39.940182 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:39.940138    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:40.153981 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.153950    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:18:40.158066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.158045    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.215577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.215547    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-b81a7a-openshift-default-dockercfg-btsst\""
Oct 30 23:18:40.218796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.218469    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:18:40.279175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.279038    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:18:40.282392 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:40.282362    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e6a195_f46b_4a23_9751_82da2f310bd1.slice/crio-6b90fe4072d27cd2aee2e1e167b2a98a7a9ddad76ff3f55dc8f07a78b24bdbcf WatchSource:0}: Error finding container 6b90fe4072d27cd2aee2e1e167b2a98a7a9ddad76ff3f55dc8f07a78b24bdbcf: Status 404 returned error can't find the container with id 6b90fe4072d27cd2aee2e1e167b2a98a7a9ddad76ff3f55dc8f07a78b24bdbcf
Oct 30 23:18:40.285515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.285477    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:40.285573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.285561    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:40.285650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.285605    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:40.342172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.342137    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2bh\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.342326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.342177    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.342326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.342266    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.343243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343186    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.343358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343257    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.343358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343304    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.343469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343405    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.343469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343456    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.344097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.343503    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.444731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444700    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.444912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444744    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.444912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444810    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.444912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444833    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.444912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444868    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444915    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2bh\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444951    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.444982    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445031    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445212    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445242    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445257    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445417    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.445776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.445757    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.447475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.447449    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.447589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.447514    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.502731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.502697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.502871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.502796    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2bh\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.710057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.709955    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerStarted","Data":"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"}
Oct 30 23:18:40.710057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.710020    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerStarted","Data":"6b90fe4072d27cd2aee2e1e167b2a98a7a9ddad76ff3f55dc8f07a78b24bdbcf"}
Oct 30 23:18:40.711573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.711549    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerStarted","Data":"8ffa7aef0ad309e055e4d015980d8d1cce3e98814219b86215076e7e650cca6d"}
Oct 30 23:18:40.711671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.711602    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerStarted","Data":"b6c3bc69e4e6a5bb08d881c258243f4f33a70f31c8dda3599db11c3ab221e96b"}
Oct 30 23:18:40.770863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.770830    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:40.829780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.829726    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podStartSLOduration=1.829706232 podStartE2EDuration="1.829706232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:40.828253988 +0000 UTC m=+692.588346558" watchObservedRunningTime="2026-10-30 23:18:40.829706232 +0000 UTC m=+692.589798803"
Oct 30 23:18:40.878677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.878642    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:40.880010 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.879987    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:40.947695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:40.947640    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podStartSLOduration=1.947605018 podStartE2EDuration="1.947605018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:40.945670364 +0000 UTC m=+692.705762933" watchObservedRunningTime="2026-10-30 23:18:40.947605018 +0000 UTC m=+692.707697588"
Oct 30 23:18:41.180118 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.180089    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:18:41.182241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:41.182208    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebef83cd_b6f7_4614_88d1_52949505d39c.slice/crio-0de5e3b69fbe465ee7404f11b657acc583c0cd9e25ad7cce9a426964ba0991d3 WatchSource:0}: Error finding container 0de5e3b69fbe465ee7404f11b657acc583c0cd9e25ad7cce9a426964ba0991d3: Status 404 returned error can't find the container with id 0de5e3b69fbe465ee7404f11b657acc583c0cd9e25ad7cce9a426964ba0991d3
Oct 30 23:18:41.185002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.184965    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:41.185129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.185032    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:41.185129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.185059    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:18:41.524815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.524786    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:41.530137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.530113    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:41.717968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.717935    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerStarted","Data":"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"}
Oct 30 23:18:41.718128 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.717992    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerStarted","Data":"0de5e3b69fbe465ee7404f11b657acc583c0cd9e25ad7cce9a426964ba0991d3"}
Oct 30 23:18:41.718524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.718493    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:41.718679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.718550    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:41.719538 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.719507    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:18:41.719638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.719580    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:18:41.771762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.771740    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:41.885524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:41.885451    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:42.006667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:42.006579    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podStartSLOduration=2.006558476 podStartE2EDuration="2.006558476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:41.879907294 +0000 UTC m=+693.639999866" watchObservedRunningTime="2026-10-30 23:18:42.006558476 +0000 UTC m=+693.766651048"
Oct 30 23:18:42.723385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:42.723347    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:42.724061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:42.724045    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:18:42.776228 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:42.776199    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:43.728852 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:43.728820    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:43.729410 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:43.729393    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:18:49.343350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.343318    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:18:49.347989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.347969    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.403055 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.403029    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-057303-serving-cert\""
Oct 30 23:18:49.445496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.445463    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.445662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.445543    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.445662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.445576    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.445800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.445730    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbl4h\" (UniqueName: \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.455553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.455531    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:18:49.546683 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.546654    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.546868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.546697    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.546868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.546728    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.546868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.546785    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbl4h\" (UniqueName: \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.547043 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:49.546912    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-serving-cert: secret "maas-api-e2e-worker-w0-057303-serving-cert" not found
Oct 30 23:18:49.547043 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:49.547025    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls podName:532ac912-3fb8-47b8-b23f-3451c284295c nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.047002096 +0000 UTC m=+701.807094645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls") pod "maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" (UID: "532ac912-3fb8-47b8-b23f-3451c284295c") : secret "maas-api-e2e-worker-w0-057303-serving-cert" not found
Oct 30 23:18:49.547710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.547681    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.549360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.549336    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:49.606440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:49.606364    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbl4h\" (UniqueName: \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:50.053405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:50.053368    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:50.056106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:50.056081    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:50.261850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:50.261816    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:50.638145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:50.638122    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:18:50.640374 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:50.640348    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532ac912_3fb8_47b8_b23f_3451c284295c.slice/crio-c780daaf1a4679995d6448009692f5f09a59fb2725eb8dc3498cd3f34ff87644 WatchSource:0}: Error finding container c780daaf1a4679995d6448009692f5f09a59fb2725eb8dc3498cd3f34ff87644: Status 404 returned error can't find the container with id c780daaf1a4679995d6448009692f5f09a59fb2725eb8dc3498cd3f34ff87644
Oct 30 23:18:50.766822 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:50.766786    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" event={"ID":"532ac912-3fb8-47b8-b23f-3451c284295c","Type":"ContainerStarted","Data":"c780daaf1a4679995d6448009692f5f09a59fb2725eb8dc3498cd3f34ff87644"}
Oct 30 23:18:51.773925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:51.773845    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" event={"ID":"532ac912-3fb8-47b8-b23f-3451c284295c","Type":"ContainerStarted","Data":"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"}
Oct 30 23:18:51.774602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:51.774585    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:18:51.894834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:51.894779    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" podStartSLOduration=2.048719192 podStartE2EDuration="2.894761831s" totalImagesPullingTime="846.042639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:51.891867066 +0000 UTC m=+703.651959637" watchObservedRunningTime="2026-10-30 23:18:51.894761831 +0000 UTC m=+703.654854404"
Oct 30 23:18:54.841555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.841525    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:18:54.849784 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.847742    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:54.901215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.901184    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-aadaa6-serving-cert\""
Oct 30 23:18:54.904797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.904769    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:54.904946 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.904931    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknqj\" (UniqueName: \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:54.905044 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.905027    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:54.905115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.905098    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:54.953841 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:54.953807    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:18:55.006838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.006804    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.007000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.006865    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.007000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.006901    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.007000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.006985    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknqj\" (UniqueName: \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.007145 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:55.007000    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-serving-cert: secret "maas-api-e2e-worker-w6-aadaa6-serving-cert" not found
Oct 30 23:18:55.007145 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:18:55.007084    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls podName:8d15304e-984a-4e64-8bd5-f53283f8f05d nodeName:}" failed. No retries permitted until 2026-10-30 23:18:55.507062994 +0000 UTC m=+707.267155565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls") pod "maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" (UID: "8d15304e-984a-4e64-8bd5-f53283f8f05d") : secret "maas-api-e2e-worker-w6-aadaa6-serving-cert" not found
Oct 30 23:18:55.007762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.007678    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.009451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.009431    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.065099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.065070    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknqj\" (UniqueName: \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.512502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.512463    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.515310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.515276    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") pod \"maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:55.763201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:55.763115    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:56.181253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:56.181228    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:18:56.185050 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:18:56.183728    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d15304e_984a_4e64_8bd5_f53283f8f05d.slice/crio-b91b3fd92fef3cb72cdb9c6221eee7b4d60e11f6ad0c498dc83e6cf3fe598a31 WatchSource:0}: Error finding container b91b3fd92fef3cb72cdb9c6221eee7b4d60e11f6ad0c498dc83e6cf3fe598a31: Status 404 returned error can't find the container with id b91b3fd92fef3cb72cdb9c6221eee7b4d60e11f6ad0c498dc83e6cf3fe598a31
Oct 30 23:18:56.833983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:56.833951    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" event={"ID":"8d15304e-984a-4e64-8bd5-f53283f8f05d","Type":"ContainerStarted","Data":"b91b3fd92fef3cb72cdb9c6221eee7b4d60e11f6ad0c498dc83e6cf3fe598a31"}
Oct 30 23:18:57.845435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:57.845393    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" event={"ID":"8d15304e-984a-4e64-8bd5-f53283f8f05d","Type":"ContainerStarted","Data":"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"}
Oct 30 23:18:57.846397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:57.846371    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:18:57.966349 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:57.966293    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" podStartSLOduration=3.172980481 podStartE2EDuration="3.966276804s" totalImagesPullingTime="793.296323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:57.963974197 +0000 UTC m=+709.724066769" watchObservedRunningTime="2026-10-30 23:18:57.966276804 +0000 UTC m=+709.726369375"
Oct 30 23:18:58.814971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:18:58.814944    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:19:00.272760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.272729    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:19:00.277349 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.277324    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.331794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.331769    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-b81a7a-serving-cert\""
Oct 30 23:19:00.372542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.372512    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.372699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.372582    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.372699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.372669    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m6nw\" (UniqueName: \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.372773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.372705    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.403738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.403701    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:19:00.474183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.474147    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.474338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.474201    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m6nw\" (UniqueName: \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.474338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.474232    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.474421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.474354    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.474484 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:00.474471    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-serving-cert: secret "maas-api-e2e-worker-w1-b81a7a-serving-cert" not found
Oct 30 23:19:00.474555 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:00.474546    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls podName:e6742a7c-7d38-432a-a159-d34a2621995d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:00.974527393 +0000 UTC m=+712.734619942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls") pod "maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" (UID: "e6742a7c-7d38-432a-a159-d34a2621995d") : secret "maas-api-e2e-worker-w1-b81a7a-serving-cert" not found
Oct 30 23:19:00.474988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.474965    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.476863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.476834    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.533307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.533229    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m6nw\" (UniqueName: \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:00.993916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:00.983445    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:01.010656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:01.010592    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:01.218192 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:01.218158    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:01.662193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:01.662086    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:19:01.664736 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:19:01.664709    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6742a7c_7d38_432a_a159_d34a2621995d.slice/crio-360d61024ce9ac43d6aa01a81a4eec646b1d07ae68b8a5d629e7280db520caf1 WatchSource:0}: Error finding container 360d61024ce9ac43d6aa01a81a4eec646b1d07ae68b8a5d629e7280db520caf1: Status 404 returned error can't find the container with id 360d61024ce9ac43d6aa01a81a4eec646b1d07ae68b8a5d629e7280db520caf1
Oct 30 23:19:01.899642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:01.878638    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" event={"ID":"e6742a7c-7d38-432a-a159-d34a2621995d","Type":"ContainerStarted","Data":"360d61024ce9ac43d6aa01a81a4eec646b1d07ae68b8a5d629e7280db520caf1"}
Oct 30 23:19:02.911448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:02.911339    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" event={"ID":"e6742a7c-7d38-432a-a159-d34a2621995d","Type":"ContainerStarted","Data":"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"}
Oct 30 23:19:02.911886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:02.911526    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:03.031376 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:03.031315    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" podStartSLOduration=2.167024984 podStartE2EDuration="3.031300762s" totalImagesPullingTime="864.275778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:03.029103018 +0000 UTC m=+714.789195590" watchObservedRunningTime="2026-10-30 23:19:03.031300762 +0000 UTC m=+714.791393332"
Oct 30 23:19:04.151404 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:04.151371    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:19:04.874955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:04.874926    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:19:05.647665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.647627    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:19:05.652152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.652133    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.676268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.676232    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.676430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.676299    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.676492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.676470    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.676531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.676513    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxc6\" (UniqueName: \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.712170 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.712133    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-3c9613-serving-cert\""
Oct 30 23:19:05.714220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.714175    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:19:05.777333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.777298    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.777564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.777365    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.777564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.777488    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.777564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.777526    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxc6\" (UniqueName: \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.777768 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:05.777680    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-serving-cert: secret "maas-api-e2e-worker-w2-3c9613-serving-cert" not found
Oct 30 23:19:05.777768 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:05.777767    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls podName:21c93061-e5dd-4f46-b4ac-ee32879faada nodeName:}" failed. No retries permitted until 2026-10-30 23:19:06.277743048 +0000 UTC m=+718.037835615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls") pod "maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" (UID: "21c93061-e5dd-4f46-b4ac-ee32879faada") : secret "maas-api-e2e-worker-w2-3c9613-serving-cert" not found
Oct 30 23:19:05.778181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.778156    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.779897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.779873    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:05.837682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:05.837577    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxc6\" (UniqueName: \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:06.284083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:06.284041    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:06.287026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:06.286995    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:06.568423 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:06.568345    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:06.963565 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:06.963541    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:19:06.967006 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:19:06.966970    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c93061_e5dd_4f46_b4ac_ee32879faada.slice/crio-f782c26000ca45add0c6e81b509ea0f1ee9240c6bad51ba8ae63794114d50f62 WatchSource:0}: Error finding container f782c26000ca45add0c6e81b509ea0f1ee9240c6bad51ba8ae63794114d50f62: Status 404 returned error can't find the container with id f782c26000ca45add0c6e81b509ea0f1ee9240c6bad51ba8ae63794114d50f62
Oct 30 23:19:07.944571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.944502    6126 generic.go:356] "Generic (PLEG): container finished" podID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerID="6f761952cb5c0785aa295cc26019674ab2c31620a7aeb55fd7214427ce9e3b85" exitCode=0
Oct 30 23:19:07.944807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.944581    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerDied","Data":"6f761952cb5c0785aa295cc26019674ab2c31620a7aeb55fd7214427ce9e3b85"}
Oct 30 23:19:07.945131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.945107    6126 scope.go:122] "RemoveContainer" containerID="6f761952cb5c0785aa295cc26019674ab2c31620a7aeb55fd7214427ce9e3b85"
Oct 30 23:19:07.946398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.946378    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" event={"ID":"21c93061-e5dd-4f46-b4ac-ee32879faada","Type":"ContainerStarted","Data":"f782c26000ca45add0c6e81b509ea0f1ee9240c6bad51ba8ae63794114d50f62"}
Oct 30 23:19:07.946573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.946546    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:07.946661 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.946646    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:07.946704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:07.946684    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:08.936079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:08.936047    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:19:08.953732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:08.953696    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerStarted","Data":"232b38c27e33fa14892d012cb94d4b3e46c03c37ce47aec9e4caea723255c789"}
Oct 30 23:19:08.955878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:08.955850    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" event={"ID":"21c93061-e5dd-4f46-b4ac-ee32879faada","Type":"ContainerStarted","Data":"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"}
Oct 30 23:19:08.956427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:08.956409    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:09.398642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:09.393512    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" podStartSLOduration=3.588763927 podStartE2EDuration="4.393493143s" totalImagesPullingTime="804.729216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:09.393059137 +0000 UTC m=+721.153151710" watchObservedRunningTime="2026-10-30 23:19:09.393493143 +0000 UTC m=+721.153585716"
Oct 30 23:19:09.874993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:09.874959    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:19:09.875988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:09.875966    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 30 23:19:09.876092 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:09.876017    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 30 23:19:10.875668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:10.875604    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 30 23:19:10.876156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:10.875681    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 30 23:19:11.723643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:11.722731    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:19:11.875327 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:11.875293    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 30 23:19:11.875500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:11.875340    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 30 23:19:12.875583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:12.875545    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 30 23:19:12.876019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:12.875602    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 30 23:19:13.875560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:13.875461    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 30 23:19:13.875560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:13.875517    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 30 23:19:14.769807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:14.769766    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:19:14.769996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:14.769844    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:19:14.880143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:14.880110    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:19:14.881492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:14.881468    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:19:15.977880 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:15.977851    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:19:17.023718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.023636    6126 generic.go:356] "Generic (PLEG): container finished" podID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerID="d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473" exitCode=0
Oct 30 23:19:17.023718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.023697    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerDied","Data":"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"}
Oct 30 23:19:17.024166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.024084    6126 scope.go:122] "RemoveContainer" containerID="d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"
Oct 30 23:19:17.025375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.025341    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:17.025498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.025435    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:17.025498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:17.025488    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:18.032076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:18.032032    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerStarted","Data":"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"}
Oct 30 23:19:18.771040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:18.770994    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:19:18.771252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:18.771224    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 23:19:18.771326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:18.771281    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 23:19:19.771278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:19.771238    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 23:19:19.771695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:19.771307    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 23:19:20.771697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:20.771661    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 23:19:20.772193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:20.771715    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 23:19:21.771503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:21.771463    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 23:19:21.771732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:21.771530    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 23:19:22.771671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:22.771635    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 23:19:22.771839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:22.771699    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 23:19:23.775927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:23.775899    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:19:23.776415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:23.776403    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:19:23.777148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:23.777124    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:19:25.530466 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.530431    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:19:25.534536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.534516    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.632040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.632006    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.632208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.632127    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.632208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.632165    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsq8\" (UniqueName: \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.632387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.632360    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.639513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.639487    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-5dc3c0-serving-cert\""
Oct 30 23:19:25.641772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.641747    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:19:25.733886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.733846    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.734099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.733960    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.734099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.734014    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsq8\" (UniqueName: \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.734239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.734117    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.734306 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:25.734115    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-serving-cert: secret "maas-api-e2e-worker-w5-5dc3c0-serving-cert" not found
Oct 30 23:19:25.734364 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:25.734323    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls podName:82ccf2d4-7140-43de-844a-78e35f84a2f3 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:26.234298537 +0000 UTC m=+737.994391108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls") pod "maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" (UID: "82ccf2d4-7140-43de-844a-78e35f84a2f3") : secret "maas-api-e2e-worker-w5-5dc3c0-serving-cert" not found
Oct 30 23:19:25.735049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.735018    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.737076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.737047    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:25.793026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:25.792941    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsq8\" (UniqueName: \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:26.241179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:26.241135    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:26.243885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:26.243855    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:26.449011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:26.448969    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:26.837521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:26.837494    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:19:26.839475 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:19:26.839442    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ccf2d4_7140_43de_844a_78e35f84a2f3.slice/crio-a2b4cca88db6f6b8f2612d737bfc31d9636c672c7199bb40183f06c07dd92fcb WatchSource:0}: Error finding container a2b4cca88db6f6b8f2612d737bfc31d9636c672c7199bb40183f06c07dd92fcb: Status 404 returned error can't find the container with id a2b4cca88db6f6b8f2612d737bfc31d9636c672c7199bb40183f06c07dd92fcb
Oct 30 23:19:27.092164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:27.092074    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" event={"ID":"82ccf2d4-7140-43de-844a-78e35f84a2f3","Type":"ContainerStarted","Data":"a2b4cca88db6f6b8f2612d737bfc31d9636c672c7199bb40183f06c07dd92fcb"}
Oct 30 23:19:28.101885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:28.101853    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" event={"ID":"82ccf2d4-7140-43de-844a-78e35f84a2f3","Type":"ContainerStarted","Data":"444215b73b2a6b61a4dd39087fc3a93835a2449eb022cf85356cafb02fb1265d"}
Oct 30 23:19:28.102309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:28.102043    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:28.217665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:28.217606    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:60684->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Oct 30 23:19:28.217823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:28.217704    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:60684->10.134.0.50:15021: read: connection reset by peer"
Oct 30 23:19:28.222090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:28.222037    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" podStartSLOduration=2.419667848 podStartE2EDuration="3.222019046s" totalImagesPullingTime="802.351198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:28.219525308 +0000 UTC m=+739.979617879" watchObservedRunningTime="2026-10-30 23:19:28.222019046 +0000 UTC m=+739.982111620"
Oct 30 23:19:29.110124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.110087    6126 generic.go:356] "Generic (PLEG): container finished" podID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerID="2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22" exitCode=0
Oct 30 23:19:29.110518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.110154    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerDied","Data":"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"}
Oct 30 23:19:29.110810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.110796    6126 scope.go:122] "RemoveContainer" containerID="2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"
Oct 30 23:19:29.112077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.112044    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:29.112191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.112127    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:29.112191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:29.112179    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:30.118884 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:30.118847    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerStarted","Data":"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"}
Oct 30 23:19:30.886645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:30.882987    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:19:30.886645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:30.883144    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 23:19:30.886645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:30.883189    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 23:19:31.891779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:31.891737    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 23:19:31.892518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:31.892482    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 23:19:32.900054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:32.900019    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 23:19:32.900697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:32.900660    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 23:19:33.882643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:33.882033    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 23:19:33.882643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:33.882097    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 23:19:34.129886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:34.128801    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:19:34.162736 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:19:34.162644    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:19:34.883367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:34.882941    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 23:19:34.883367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:34.883001    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 23:19:35.905947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:35.905902    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:19:35.907142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:35.907123    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:19:35.910593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:35.910471    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:19:40.200329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.200293    6126 generic.go:356] "Generic (PLEG): container finished" podID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerID="8ffa7aef0ad309e055e4d015980d8d1cce3e98814219b86215076e7e650cca6d" exitCode=0
Oct 30 23:19:40.200788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.200379    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerDied","Data":"8ffa7aef0ad309e055e4d015980d8d1cce3e98814219b86215076e7e650cca6d"}
Oct 30 23:19:40.200949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.200931    6126 scope.go:122] "RemoveContainer" containerID="8ffa7aef0ad309e055e4d015980d8d1cce3e98814219b86215076e7e650cca6d"
Oct 30 23:19:40.202427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.202398    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:40.202484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.202468    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:40.202518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:40.202503    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:19:41.219234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:41.219202    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerStarted","Data":"2804141609b13c2c29b979409bcb73643a161d20f83f7dbe68eb7df2e4b5afa4"}
Oct 30 23:19:41.524770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:41.524676    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:19:41.526204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:41.526174    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 23:19:41.526345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:41.526236    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 23:19:41.719186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:41.719151    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:19:42.525199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:42.525159    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 23:19:42.525603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:42.525224    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 23:19:43.524801 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:43.524765    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 23:19:43.524985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:43.524817    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 23:19:44.524989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:44.524957    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 23:19:44.525425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:44.525022    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 23:19:45.525208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:45.525173    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 23:19:45.525649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:45.525235    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 23:19:46.530038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:46.530004    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:19:46.531211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:19:46.531189    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:20:04.150814 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:20:04.150772    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:20:34.151076 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:20:34.151040    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:21:04.151149 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:21:04.151072    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:21:34.149408 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:21:34.149368    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:21:44.575093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.575062    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:21:44.579073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.579057    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595535    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspzf\" (UniqueName: \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595587    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595694    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595735    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595820    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.595869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.595845    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.682869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.682838    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b81a7a\"/\"kube-root-ca.crt\""
Oct 30 23:21:44.683171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.683153    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b81a7a\"/\"openshift-service-ca.crt\""
Oct 30 23:21:44.683259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.683180    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b81a7a\"/\"default-dockercfg-hwvw7\""
Oct 30 23:21:44.683557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.683545    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b81a7a\"/\"premium-w1-b81a7a-kserve-self-signed-certs\""
Oct 30 23:21:44.685428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.685408    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:21:44.696923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.696895    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspzf\" (UniqueName: \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.696952    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.696984    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697020    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697165 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697059    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697165 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697088    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697415    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697457    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.697526 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.697478    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.699566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.699540    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.699566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.699550    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.754939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.754906    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspzf\" (UniqueName: \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\") pod \"premium-w1-b81a7a-kserve-7888989d89-ssfp6\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") " pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:44.890502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:44.890417    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:45.282929 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:45.282907    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:21:45.284902 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:21:45.284871    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod740a827a_149d_4204_b93a_6bc0a93aa90d.slice/crio-9ec0a48a53c02409e006ac3ce69b9977307539426bc68145ba2a444f3b191f10 WatchSource:0}: Error finding container 9ec0a48a53c02409e006ac3ce69b9977307539426bc68145ba2a444f3b191f10: Status 404 returned error can't find the container with id 9ec0a48a53c02409e006ac3ce69b9977307539426bc68145ba2a444f3b191f10
Oct 30 23:21:45.987833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:45.987801    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" event={"ID":"740a827a-149d-4204-b93a-6bc0a93aa90d","Type":"ContainerStarted","Data":"bb274937330a081633add62bf08fb99741553304eb24201b2c71c672a83dd33c"}
Oct 30 23:21:45.987833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:45.987841    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" event={"ID":"740a827a-149d-4204-b93a-6bc0a93aa90d","Type":"ContainerStarted","Data":"9ec0a48a53c02409e006ac3ce69b9977307539426bc68145ba2a444f3b191f10"}
Oct 30 23:21:46.106757 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:46.106705    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podStartSLOduration=2.106691812 podStartE2EDuration="2.106691812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:21:46.104443293 +0000 UTC m=+877.864535865" watchObservedRunningTime="2026-10-30 23:21:46.106691812 +0000 UTC m=+877.866784382"
Oct 30 23:21:46.890980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:46.890946    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:54.891100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:54.891067    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:54.904407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:54.904380    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:21:55.058742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:21:55.058710    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:22:04.150541 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:22:04.150495    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:22:08.521465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:08.521430    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:22:08.522059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:08.521923    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:22:34.151006 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:22:34.150971    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:22:40.890467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:40.890433    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:22:40.894466 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:40.894447    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:40.946773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:40.946745    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-aadaa6-openshift-default-dockercfg-6bsq5\""
Oct 30 23:22:41.000160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.000129    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:22:41.034436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034399    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034445    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034529    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034601    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdp5v\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034747    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034779    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034803    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034911    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.034985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.034944    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.135889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.135861    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.135889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.135893    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.135912    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.135966    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.135996    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136122    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136148    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136176    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136226    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdp5v\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136344    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136416    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136666    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136726    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.136842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.136759    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.138760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.138733    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.138865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.138849    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.193497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.193438    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.193609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.193553    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdp5v\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.207462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.207442    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:41.641839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.641813    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:22:41.644848 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:22:41.644821    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40e3195_a8ae_42eb_9898_ac80a12816a9.slice/crio-84e2ceadd744e6479ea857ad3e825846756825905be7f137f1c98a38564fe794 WatchSource:0}: Error finding container 84e2ceadd744e6479ea857ad3e825846756825905be7f137f1c98a38564fe794: Status 404 returned error can't find the container with id 84e2ceadd744e6479ea857ad3e825846756825905be7f137f1c98a38564fe794
Oct 30 23:22:41.647055 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.647025    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:22:41.647120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.647090    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:22:41.647160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:41.647117    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:22:42.337778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:42.337732    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" event={"ID":"b40e3195-a8ae-42eb-9898-ac80a12816a9","Type":"ContainerStarted","Data":"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"}
Oct 30 23:22:42.338265 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:42.337829    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" event={"ID":"b40e3195-a8ae-42eb-9898-ac80a12816a9","Type":"ContainerStarted","Data":"84e2ceadd744e6479ea857ad3e825846756825905be7f137f1c98a38564fe794"}
Oct 30 23:22:42.460777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:42.460727    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podStartSLOduration=2.460713605 podStartE2EDuration="2.460713605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:22:42.458157236 +0000 UTC m=+934.218249822" watchObservedRunningTime="2026-10-30 23:22:42.460713605 +0000 UTC m=+934.220806174"
Oct 30 23:22:43.208512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:43.208482    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:43.210058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:43.210031    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 23:22:43.210191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:43.210078    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 23:22:44.208013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:44.207973    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 23:22:44.208633 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:44.208581    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 23:22:45.210057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:45.210022    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 23:22:45.210723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:45.210689    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 23:22:46.210070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:46.210035    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 23:22:46.210736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:46.210688    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 23:22:47.207894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:47.207857    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 23:22:47.208210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:47.208163    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 23:22:48.311857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:48.311822    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:48.312338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:48.312282    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:22:48.313233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:22:48.313206    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:23:04.150515 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:23:04.150473    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:23:10.821683 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:10.821650    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:23:10.827816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:10.827795    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:10.880655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:10.880603    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-5dc3c0-openshift-default-dockercfg-f5r9h\""
Oct 30 23:23:10.934882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:10.934837    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:23:11.009421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009385    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009464    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009532    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009784 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009662    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2jpv\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009818    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009847    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.009985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009947    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.010027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.009978    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.010072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.010020    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111112    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111147    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111284    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111323    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111482    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111531    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111571    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111584    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111632    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111769    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111803    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111805    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.111891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.111862    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2jpv\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.112234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.112207    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.113644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.113603    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.114264 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.114244    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.169285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.169261    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.169718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.169696    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2jpv\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.440855 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.440765    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:11.873402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.873373    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:23:11.875228 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:23:11.875199    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366e3138_e246_4b7e_b84a_cd50f3bbdecb.slice/crio-ca4ba77ed0fd5d149157f0d28be7e8f4acae0726119f5dcfd1f6135a4f6f6e4a WatchSource:0}: Error finding container ca4ba77ed0fd5d149157f0d28be7e8f4acae0726119f5dcfd1f6135a4f6f6e4a: Status 404 returned error can't find the container with id ca4ba77ed0fd5d149157f0d28be7e8f4acae0726119f5dcfd1f6135a4f6f6e4a
Oct 30 23:23:11.877999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.877968    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:11.878072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.878032    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:11.878072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:11.878062    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:12.518311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:12.518265    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" event={"ID":"366e3138-e246-4b7e-b84a-cd50f3bbdecb","Type":"ContainerStarted","Data":"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"}
Oct 30 23:23:12.518525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:12.518329    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" event={"ID":"366e3138-e246-4b7e-b84a-cd50f3bbdecb","Type":"ContainerStarted","Data":"ca4ba77ed0fd5d149157f0d28be7e8f4acae0726119f5dcfd1f6135a4f6f6e4a"}
Oct 30 23:23:12.641884 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:12.641832    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podStartSLOduration=2.641817542 podStartE2EDuration="2.641817542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:23:12.64047109 +0000 UTC m=+964.400563663" watchObservedRunningTime="2026-10-30 23:23:12.641817542 +0000 UTC m=+964.401910112"
Oct 30 23:23:13.441354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:13.441319    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:13.443131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:13.443095    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 23:23:13.443283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:13.443154    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 23:23:14.441573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:14.441543    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 23:23:14.441998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:14.441595    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 23:23:15.441462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:15.441423    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 23:23:15.441679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:15.441476    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 23:23:16.441856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:16.441815    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 23:23:16.442241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:16.441873    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 23:23:17.441733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:17.441698    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 23:23:17.441939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:17.441758    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 23:23:18.534839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:18.533192    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:18.534839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:18.534771    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:18.535830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:18.535552    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:23:34.153996 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:23:34.153952    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:23:54.731516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.731419    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:23:54.736373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.736348    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.794948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.794918    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:23:54.859364 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859334    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859466    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859520    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859588    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz7z\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859649    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859669    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859689    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859722    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.859874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.859845    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960658    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960719    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960757    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz7z\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960795    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960824    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.960893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960853    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960888    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960961    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.960996    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.961087    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.961312    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.961500    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.961842    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.961981 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.961953    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.964238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.963948    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:54.964601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:54.964580    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:55.022389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.022322    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:55.022548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.022515    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz7z\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\") pod \"maas-default-gateway-openshift-default-5df48fcc99-sfdgt\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:55.050843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.050817    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:55.496287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.496254    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:23:55.499978 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:23:55.499942    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ae6a55_ce8c_4ce5_a3f9_7eb6312905ec.slice/crio-a8946d767cb9886c7cd74d2978a6167c0b9cd8db8e3a9e66d9561c97f90c87d9 WatchSource:0}: Error finding container a8946d767cb9886c7cd74d2978a6167c0b9cd8db8e3a9e66d9561c97f90c87d9: Status 404 returned error can't find the container with id a8946d767cb9886c7cd74d2978a6167c0b9cd8db8e3a9e66d9561c97f90c87d9
Oct 30 23:23:55.502427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.502390    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:55.502512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.502469    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:55.502512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.502499    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:55.823753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.818578    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" event={"ID":"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec","Type":"ContainerStarted","Data":"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"}
Oct 30 23:23:55.823753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.818665    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" event={"ID":"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec","Type":"ContainerStarted","Data":"a8946d767cb9886c7cd74d2978a6167c0b9cd8db8e3a9e66d9561c97f90c87d9"}
Oct 30 23:23:55.938659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:55.938543    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podStartSLOduration=1.9385258589999999 podStartE2EDuration="1.938525859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:23:55.936215708 +0000 UTC m=+1007.696308293" watchObservedRunningTime="2026-10-30 23:23:55.938525859 +0000 UTC m=+1007.698618430"
Oct 30 23:23:56.052019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:56.051990    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:23:56.057864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:56.057831    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:23:56.058049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:56.057892    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:23:57.051962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:57.051921    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:23:57.052447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:57.051978    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:23:58.051841 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:58.051807    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:23:58.052017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:58.051870    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:23:59.051741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:59.051710    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:23:59.051924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:23:59.051761    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:24:00.051772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:00.051733    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:24:00.052217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:00.051798    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:24:01.051937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:01.051895    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:24:01.052364 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:01.051959    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:24:02.051534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:02.051497    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:24:02.051731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:02.051598    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:24:03.051293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:03.051251    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-sfdgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 23:24:03.051814 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:03.051309    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 23:24:04.056472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:04.056442    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:24:04.056991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:04.056768    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:24:04.057442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:04.057424    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:24:04.151062 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:24:04.151026    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:24:09.855180 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.855132    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:24:09.859735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.859712    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.905629 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.905580    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:24:09.909519 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.909498    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.936322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.936295    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:24:09.972266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972232    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972306    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972364    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.972520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972453    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972485    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972501    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.972705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972559    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.972705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972672    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972701    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.972863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972729    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mgw\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.972863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972832    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.972976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972875    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.973012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.972966    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdck5\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.973012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.973001    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.973086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.973025    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:09.973086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.973061    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.973166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.973083    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:09.973166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:09.973154    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.013734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.013700    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:24:10.074449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074421    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074462    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdck5\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074494    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074514    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074539    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074648    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.074696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074697    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074764    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074790    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074848    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074882    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074908    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.074949    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.075013    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.075037    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.075065    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mgw\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.075127    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.076681    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.077326 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.077262    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.078886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.077896    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.078886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.077973    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.078886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.078512    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.078886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.078556    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.079163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.079091    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.079412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.079391    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.080113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.080090    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.080413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.080392    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.081245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.081205    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.081567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.081542    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.082763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.082739    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.083753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.083731    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.134239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.134165    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdck5\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.135058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.135033    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.135316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.135286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-qvcb4\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.136309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.136280    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mgw\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\") pod \"maas-default-gateway-openshift-default-5df48fcc99-xrgdn\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.172740 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.172712    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:10.223355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.223326    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:10.613080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.613045    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:24:10.653522 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:10.653492    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490deeea_16f2_46be_8ddb_9e25f9dd3241.slice/crio-cef9bd7a4518908a6c11efb78fe9ab51e0bbca2a21c9959aac1b44ccaa47e208 WatchSource:0}: Error finding container cef9bd7a4518908a6c11efb78fe9ab51e0bbca2a21c9959aac1b44ccaa47e208: Status 404 returned error can't find the container with id cef9bd7a4518908a6c11efb78fe9ab51e0bbca2a21c9959aac1b44ccaa47e208
Oct 30 23:24:10.656203 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.656171    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.656283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.656239    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.656283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.656270    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.666486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.666432    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:24:10.668970 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:10.668945    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aa0e58_87d0_4009_87e6_a0171d7e5599.slice/crio-7a618cb04cb4109b194bc0f940a8ce9d2296c672c526a2f439711f108a921071 WatchSource:0}: Error finding container 7a618cb04cb4109b194bc0f940a8ce9d2296c672c526a2f439711f108a921071: Status 404 returned error can't find the container with id 7a618cb04cb4109b194bc0f940a8ce9d2296c672c526a2f439711f108a921071
Oct 30 23:24:10.671421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.671388    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.671500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.671464    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.671546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.671512    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:10.987091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.987050    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" event={"ID":"e0aa0e58-87d0-4009-87e6-a0171d7e5599","Type":"ContainerStarted","Data":"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"}
Oct 30 23:24:10.987675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.987110    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" event={"ID":"e0aa0e58-87d0-4009-87e6-a0171d7e5599","Type":"ContainerStarted","Data":"7a618cb04cb4109b194bc0f940a8ce9d2296c672c526a2f439711f108a921071"}
Oct 30 23:24:10.989125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.989095    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" event={"ID":"490deeea-16f2-46be-8ddb-9e25f9dd3241","Type":"ContainerStarted","Data":"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"}
Oct 30 23:24:10.989261 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:10.989153    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" event={"ID":"490deeea-16f2-46be-8ddb-9e25f9dd3241","Type":"ContainerStarted","Data":"cef9bd7a4518908a6c11efb78fe9ab51e0bbca2a21c9959aac1b44ccaa47e208"}
Oct 30 23:24:11.107802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.107752    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podStartSLOduration=2.107736813 podStartE2EDuration="2.107736813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:11.104213014 +0000 UTC m=+1022.864305587" watchObservedRunningTime="2026-10-30 23:24:11.107736813 +0000 UTC m=+1022.867829383"
Oct 30 23:24:11.173330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.173115    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:11.174534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.174482    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:11.174707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.174554    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:11.236811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.236779    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:11.238694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.238551    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:11.238694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:11.238608    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:12.173368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.173330    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:12.173923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.173398    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:12.258807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.258770    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:12.259109 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.259069    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:12.556378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.556325    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podStartSLOduration=3.556312226 podStartE2EDuration="3.556312226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:11.236130114 +0000 UTC m=+1022.996222684" watchObservedRunningTime="2026-10-30 23:24:12.556312226 +0000 UTC m=+1024.316404797"
Oct 30 23:24:12.559838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.559808    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:24:12.565135 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.565112    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.627644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.623825    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-3c9613-openshift-default-dockercfg-n6hzr\""
Oct 30 23:24:12.653525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.653485    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:24:12.658739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658714    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.658861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658746    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.658861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658770    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.658861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658827    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.658861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658843    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.658861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658857    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxs7\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.659080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658911    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.659080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.658947    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.659080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.659004    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760374    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760607 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760469    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760607 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760506    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760607 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760530    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760607 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760563    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760728    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760761    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760787    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760787    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxs7\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.760887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.760886    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.761134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.761081    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.761134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.761092    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.761386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.761353    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.761558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.761538    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.763888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.763863    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.764058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.764040    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.830689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.827415    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxs7\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.846920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.846853    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:12.904642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:12.903834    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:13.173102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.173024    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:13.173102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.173071    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:13.235067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.234949    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:13.235067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.235010    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:13.453564 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:13.453531    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10601e56_1814_419b_bc3d_5b3cc11f76be.slice/crio-4ca7eb7d50395b25df4ed2d19f2f571c591721b375f38c0a56a3b0f93ea1fdc9 WatchSource:0}: Error finding container 4ca7eb7d50395b25df4ed2d19f2f571c591721b375f38c0a56a3b0f93ea1fdc9: Status 404 returned error can't find the container with id 4ca7eb7d50395b25df4ed2d19f2f571c591721b375f38c0a56a3b0f93ea1fdc9
Oct 30 23:24:13.453786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.453763    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:24:13.455885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.455856    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:13.455954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.455917    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:13.455987 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:13.455957    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:14.068085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.068044    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" event={"ID":"10601e56-1814-419b-bc3d-5b3cc11f76be","Type":"ContainerStarted","Data":"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"}
Oct 30 23:24:14.068294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.068115    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" event={"ID":"10601e56-1814-419b-bc3d-5b3cc11f76be","Type":"ContainerStarted","Data":"4ca7eb7d50395b25df4ed2d19f2f571c591721b375f38c0a56a3b0f93ea1fdc9"}
Oct 30 23:24:14.173509 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.173472    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:14.173684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.173528    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:14.239684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.239550    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:14.240204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.239606    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:14.918643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.917688    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:14.918867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.918710    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:14.918867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:14.918763    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:15.175869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.175779    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:15.175869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.175829    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:15.231642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.230762    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:15.231642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.230819    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:15.910639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.910023    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:15.910639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:15.910089    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:16.176451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.175967    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:16.176451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.176029    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:16.225111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.225076    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:16.225429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.225385    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:16.906062 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.906021    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:16.906358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:16.906328    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:17.173137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.173034    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:17.173137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.173106    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:17.224635 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.224591    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:17.224870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.224833    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:17.912001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.911964    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:17.912253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:17.912228    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:18.173449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.173364    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:18.174033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.174003    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:18.224884 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.224849    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:18.225202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.225168    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:18.914419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.914383    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:18.914720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:18.914691    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:19.174232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.174138    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-xrgdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 23:24:19.174820 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.174791    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 23:24:19.225676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.224719    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-qvcb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 23:24:19.225676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.224776    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 23:24:19.911090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.911047    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:19.911291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:19.911111    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:20.754331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.753913    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:20.755633 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.755561    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:20.757233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.757209    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:24:20.824874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.824840    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:20.825476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.825451    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:20.826468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.826448    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:24:20.906105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.906071    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 23:24:20.906252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.906132    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 23:24:20.978771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:20.978710    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podStartSLOduration=8.978691063 podStartE2EDuration="8.978691063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:14.239451495 +0000 UTC m=+1025.999544067" watchObservedRunningTime="2026-10-30 23:24:20.978691063 +0000 UTC m=+1032.738783635"
Oct 30 23:24:22.452306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:22.452274    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:22.452727 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:22.452706    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:22.453698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:22.453677    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:24:34.156926 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:24:34.156888    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:24:41.596926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.596892    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:24:41.601878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.601858    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653144    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653454    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkgw2\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653510    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653566    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653638    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653678    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653715    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653785    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.653834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.653812    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.711944 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.711908    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:24:41.754991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.754957    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkgw2\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755006    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755181    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755238    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755267    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755357    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755455    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755487    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755598 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755579    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755598    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755700    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755792    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.755810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.755801    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.756030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.756008    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.757788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.757758    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.758040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.758022    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.816448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.816408    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkgw2\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.818290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.818261    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.856810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.856727    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:24:41.861967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.861946    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.915776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.915749    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:41.920796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.920771    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:24:41.958586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.958550    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.958809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.958784    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.958872 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.958852    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.958954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.958935    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.959073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.958973    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.959073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.959000    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.959073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.959043    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmg46\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.959233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.959125    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:41.959233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:41.959152    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.060833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.060802    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.060944    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.060996    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061022    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061048    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061074    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061117    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmg46\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061352 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061319    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061444    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061485    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061449    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061588    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.061845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061812    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.062073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.061922    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.063537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.063511    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.063989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.063971    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.119557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.119485    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmg46\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.119825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.119805    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.176352 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.176322    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:42.354210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.354181    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:24:42.356584 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:42.356563    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0f4157_29b4_48bb_b670_a7ffbaf55fc8.slice/crio-d589dd854670255c22dd3c691b230d22ac89748d2d5ba2e5e93c288ae227cc1e WatchSource:0}: Error finding container d589dd854670255c22dd3c691b230d22ac89748d2d5ba2e5e93c288ae227cc1e: Status 404 returned error can't find the container with id d589dd854670255c22dd3c691b230d22ac89748d2d5ba2e5e93c288ae227cc1e
Oct 30 23:24:42.358975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.358942    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:42.359040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.359006    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:42.359074 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.359046    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:42.562936 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.562897    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:24:42.563090 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:42.563070    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd1d6ca_fc3f_4c78_8450_d831d3d51611.slice/crio-5aab953d07cade0e88e33d328ecdd18a16fc99a728f8a1ac829f12877c3e0500 WatchSource:0}: Error finding container 5aab953d07cade0e88e33d328ecdd18a16fc99a728f8a1ac829f12877c3e0500: Status 404 returned error can't find the container with id 5aab953d07cade0e88e33d328ecdd18a16fc99a728f8a1ac829f12877c3e0500
Oct 30 23:24:42.565736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.565704    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:42.565846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.565781    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:42.565846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:42.565824    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:43.363627 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.363571    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" event={"ID":"7bd1d6ca-fc3f-4c78-8450-d831d3d51611","Type":"ContainerStarted","Data":"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"}
Oct 30 23:24:43.364189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.364170    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" event={"ID":"7bd1d6ca-fc3f-4c78-8450-d831d3d51611","Type":"ContainerStarted","Data":"5aab953d07cade0e88e33d328ecdd18a16fc99a728f8a1ac829f12877c3e0500"}
Oct 30 23:24:43.365272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.365248    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" event={"ID":"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8","Type":"ContainerStarted","Data":"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"}
Oct 30 23:24:43.365374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.365290    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" event={"ID":"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8","Type":"ContainerStarted","Data":"d589dd854670255c22dd3c691b230d22ac89748d2d5ba2e5e93c288ae227cc1e"}
Oct 30 23:24:43.494642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.491631    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podStartSLOduration=2.491597363 podStartE2EDuration="2.491597363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:43.487376535 +0000 UTC m=+1055.247469107" watchObservedRunningTime="2026-10-30 23:24:43.491597363 +0000 UTC m=+1055.251689937"
Oct 30 23:24:43.610730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.610656    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podStartSLOduration=2.610636452 podStartE2EDuration="2.610636452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:43.609107119 +0000 UTC m=+1055.369199691" watchObservedRunningTime="2026-10-30 23:24:43.610636452 +0000 UTC m=+1055.370729018"
Oct 30 23:24:43.924644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.921574    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:43.924644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.921718    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:43.924644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:43.921759    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:44.177727 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:44.177118    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:44.201642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:44.178861    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:44.201642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:44.178935    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:44.924642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:44.924088    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:44.924642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:44.924151    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:45.177538 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:45.177462    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:45.177792 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:45.177762    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:45.918026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:45.917987    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:45.918332 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:45.918301    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:46.176881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:46.176791    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:46.176881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:46.176851    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:46.920641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:46.920089    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:46.920641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:46.920159    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:47.176746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:47.176654    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:47.176746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:47.176721    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:47.919641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:47.919063    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:47.919641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:47.919127    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:48.176977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:48.176897    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:48.177125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:48.176967    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:48.916638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:48.916197    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 23:24:48.916638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:48.916285    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 23:24:49.177675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:49.177582    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 23:24:49.178127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:49.177688    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 23:24:49.922031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:49.921982    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:49.922455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:49.922429    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:49.923377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:49.923354    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:24:50.182828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:50.182748    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:50.183221 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:50.183149    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:50.183963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:50.183942    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:24:57.989999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:57.989962    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:24:57.994871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:57.994851    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.079989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.079960    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.079998    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080038    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080149    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvh9v\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080274    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080349 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080332    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080419    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080488    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.080575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.080534    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.091745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.091708    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:24:58.182538 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182504    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.182718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182549    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.182718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182578    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.182718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182659    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.182718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182693    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182748    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.182814    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvh9v\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183028    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183106    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183115    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183251    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183279    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183411    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.183748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.183730    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.185686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.185661    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.185838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.185822    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.241030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.240962    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvh9v\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.241159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.241133    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.308876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.308845    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:24:58.743262 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.743233    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:24:58.744671 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:24:58.744643    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde3834a_34f1_4467_8f73_7408d71012ef.slice/crio-c6479ed71291a2c4e63906ae423c410e926fab7b1f3dad09b77909ba30ac33e9 WatchSource:0}: Error finding container c6479ed71291a2c4e63906ae423c410e926fab7b1f3dad09b77909ba30ac33e9: Status 404 returned error can't find the container with id c6479ed71291a2c4e63906ae423c410e926fab7b1f3dad09b77909ba30ac33e9
Oct 30 23:24:58.747190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.747154    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:58.747258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.747222    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:58.747258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:58.747254    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:24:59.563115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:59.563074    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" event={"ID":"bde3834a-34f1-4467-8f73-7408d71012ef","Type":"ContainerStarted","Data":"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"}
Oct 30 23:24:59.563586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:59.563138    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" event={"ID":"bde3834a-34f1-4467-8f73-7408d71012ef","Type":"ContainerStarted","Data":"c6479ed71291a2c4e63906ae423c410e926fab7b1f3dad09b77909ba30ac33e9"}
Oct 30 23:24:59.733303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:24:59.733245    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podStartSLOduration=2.733225272 podStartE2EDuration="2.733225272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:59.731379146 +0000 UTC m=+1071.491471717" watchObservedRunningTime="2026-10-30 23:24:59.733225272 +0000 UTC m=+1071.493317843"
Oct 30 23:25:00.309112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:00.309069    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:25:00.311527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:00.311497    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 23:25:00.311689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:00.311555    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 23:25:01.310213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:01.310175    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 23:25:01.310606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:01.310230    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 23:25:02.313654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:02.309756    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 23:25:02.313654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:02.309822    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 23:25:03.316200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:03.316164    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 23:25:03.316908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:03.316223    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 23:25:04.154043 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:25:04.154005    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:25:04.309468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:04.309433    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 23:25:04.309771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:04.309736    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 23:25:05.444793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:05.444764    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:25:05.445280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:05.445178    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:25:05.446032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:05.446014    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:25:12.413380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.413347    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:25:12.424369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.424342    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.530158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.530127    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:25:12.614089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614052    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6p4\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614102    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614214    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614246    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614279    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614361    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614400    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614432    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.614560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.614485    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.715870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.715788    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.715870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.715846    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.715970    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716027    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716058    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716103    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716151    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716186    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716379    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6p4\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716540    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716660    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716796    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.716821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.716812    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.717187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.717162    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.718364 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.718344    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.718671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.718655    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.774220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.774196    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:12.775404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:12.775384    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6p4\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:13.038373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.038341    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:13.473682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.473654    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:25:13.474445 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:25:13.474416    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5721e040_9402_4c8a_9a79_fdd346e80f2c.slice/crio-1c4fc075dcb2a0b6fa382863d90acf8ecba037ca639abf4237a61f5dc29d6fab WatchSource:0}: Error finding container 1c4fc075dcb2a0b6fa382863d90acf8ecba037ca639abf4237a61f5dc29d6fab: Status 404 returned error can't find the container with id 1c4fc075dcb2a0b6fa382863d90acf8ecba037ca639abf4237a61f5dc29d6fab
Oct 30 23:25:13.480910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.480875    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:25:13.480989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.480944    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:25:13.480989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.480976    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:25:13.712599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.712565    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" event={"ID":"5721e040-9402-4c8a-9a79-fdd346e80f2c","Type":"ContainerStarted","Data":"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"}
Oct 30 23:25:13.712791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.712642    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" event={"ID":"5721e040-9402-4c8a-9a79-fdd346e80f2c","Type":"ContainerStarted","Data":"1c4fc075dcb2a0b6fa382863d90acf8ecba037ca639abf4237a61f5dc29d6fab"}
Oct 30 23:25:13.835725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:13.835601    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podStartSLOduration=1.8355868480000002 podStartE2EDuration="1.835586848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:25:13.833256253 +0000 UTC m=+1085.593348825" watchObservedRunningTime="2026-10-30 23:25:13.835586848 +0000 UTC m=+1085.595679418"
Oct 30 23:25:14.039091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:14.039054    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:14.040830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:14.040806    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:14.040968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:14.040848    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:15.039438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:15.039394    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:15.039978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:15.039457    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:16.039417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:16.039063    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:16.039417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:16.039113    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:17.039686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:17.039036    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:17.039686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:17.039098    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:18.038902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:18.038860    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:18.039094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:18.038923    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:19.038948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:19.038911    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:19.039357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:19.038968    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:20.039302 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:20.039260    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:25:20.039824 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:20.039324    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 23:25:21.043946 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:21.043912    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:21.044515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:21.044491    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:21.045452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:21.045426    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:25:30.566080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.566049    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:25:30.570459 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.570441    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.629221 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.629186    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:25:30.675398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.675368    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-aadaa6\"/\"default-dockercfg-d4g98\""
Oct 30 23:25:30.675398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.675376    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-aadaa6\"/\"openshift-service-ca.crt\""
Oct 30 23:25:30.675398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.675397    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-aadaa6\"/\"kube-root-ca.crt\""
Oct 30 23:25:30.675763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.675402    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-aadaa6\"/\"distinct-2-w6-aadaa6-kserve-self-signed-certs\""
Oct 30 23:25:30.689030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689004    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.689187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689037    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.689243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689212    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.689278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689248    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.689278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689270    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.689367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.689354    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffst\" (UniqueName: \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.791980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.791931    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.792755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.792729    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.793455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.793435    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.793668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.793649    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffst\" (UniqueName: \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.793984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.793886    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.794116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.794101    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.794658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.794639    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.795116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.795079    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.811702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.795564    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.811702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.800713    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.811702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.806995    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.855770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.855701    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffst\" (UniqueName: \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\") pod \"distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") " pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:30.884220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:30.884180    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:31.276861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:31.276839    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:25:31.278474 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:25:31.278439    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66a72824_9a8c_4164_bb1a_67faa315e474.slice/crio-032a093b7a27627919225e919bfa4b530d0aaab2022a93d266eb38454aacf24f WatchSource:0}: Error finding container 032a093b7a27627919225e919bfa4b530d0aaab2022a93d266eb38454aacf24f: Status 404 returned error can't find the container with id 032a093b7a27627919225e919bfa4b530d0aaab2022a93d266eb38454aacf24f
Oct 30 23:25:31.849809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:31.849774    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" event={"ID":"66a72824-9a8c-4164-bb1a-67faa315e474","Type":"ContainerStarted","Data":"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"}
Oct 30 23:25:31.850223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:31.849819    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" event={"ID":"66a72824-9a8c-4164-bb1a-67faa315e474","Type":"ContainerStarted","Data":"032a093b7a27627919225e919bfa4b530d0aaab2022a93d266eb38454aacf24f"}
Oct 30 23:25:31.884346 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:31.884307    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:31.967809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:31.967755    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podStartSLOduration=1.967739879 podStartE2EDuration="1.967739879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:25:31.965673234 +0000 UTC m=+1103.725765804" watchObservedRunningTime="2026-10-30 23:25:31.967739879 +0000 UTC m=+1103.727832470"
Oct 30 23:25:34.151735 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:25:34.151610    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:25:40.884762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:40.884728    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:40.897400 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:40.897376    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:25:40.934733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:25:40.934696    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:26:04.152311 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:26:04.152274    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:26:12.553800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.553762    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:26:12.558182 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.558164    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623355    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623485    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623536    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbwn6\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623559    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623727    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623754    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623846    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623892    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.623982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.623969    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.724857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.724820    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.724879    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.724936    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.724963    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725065    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725247    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbwn6\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725297    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725381    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725398    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725450    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725410    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725740    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.725805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.725779    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.726324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.726300    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.728225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.728197    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.728515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.728499    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.759867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.759837    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:26:12.783260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.783234    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.783442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.783392    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbwn6\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:12.873429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:12.873348    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:13.312481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:13.312447    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:26:13.314707 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:26:13.314677    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20398bc7_e393_4173_9613_36522c9d27ee.slice/crio-6996e51b8151f5fff81a6cf4e1f635f138f2c313e6819529a712fa828e9a9ae3 WatchSource:0}: Error finding container 6996e51b8151f5fff81a6cf4e1f635f138f2c313e6819529a712fa828e9a9ae3: Status 404 returned error can't find the container with id 6996e51b8151f5fff81a6cf4e1f635f138f2c313e6819529a712fa828e9a9ae3
Oct 30 23:26:13.317237 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:13.317204    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:26:13.317311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:13.317266    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:26:13.317311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:13.317296    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:26:14.146502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.146462    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" event={"ID":"20398bc7-e393-4173-9613-36522c9d27ee","Type":"ContainerStarted","Data":"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"}
Oct 30 23:26:14.146953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.146528    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" event={"ID":"20398bc7-e393-4173-9613-36522c9d27ee","Type":"ContainerStarted","Data":"6996e51b8151f5fff81a6cf4e1f635f138f2c313e6819529a712fa828e9a9ae3"}
Oct 30 23:26:14.365800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.365746    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podStartSLOduration=2.365732693 podStartE2EDuration="2.365732693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:26:14.315382794 +0000 UTC m=+1146.075475366" watchObservedRunningTime="2026-10-30 23:26:14.365732693 +0000 UTC m=+1146.125825263"
Oct 30 23:26:14.873758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.873725    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:14.875483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.875457    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:14.875603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:14.875504    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:15.874402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:15.874367    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:15.874862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:15.874418    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:16.873769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:16.873735    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:16.873963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:16.873786    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:17.874061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:17.874017    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:17.874570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:17.874076    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:18.874579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:18.874544    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:18.875164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:18.874607    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:19.874002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:19.873965    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 23:26:19.874187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:19.874019    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 23:26:21.160456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:21.160428    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:21.160982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:21.160884    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:21.161877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:21.161852    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:26:34.151850 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:26:34.151808    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:26:38.200382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.200346    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:26:38.204484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.204465    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.264563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.264530    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:26:38.312989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.312944    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-2cfb80\"/\"openshift-service-ca.crt\""
Oct 30 23:26:38.312989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.312977    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-2cfb80\"/\"kube-root-ca.crt\""
Oct 30 23:26:38.313242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313044    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-2cfb80\"/\"default-dockercfg-9lpks\""
Oct 30 23:26:38.313242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313050    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-2cfb80\"/\"distinct-2-w3-2cfb80-kserve-self-signed-certs\""
Oct 30 23:26:38.313492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313473    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.313546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313504    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.313546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313538    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8jd\" (UniqueName: \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.313690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313671    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.313758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313715    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.313758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.313754    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415235 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415201    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415246    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415273    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8jd\" (UniqueName: \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415312    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415358    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415398    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415860 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415829    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415854    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.415947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.415916    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.418001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.417978    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.418267 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.418251    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.474962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.474938    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8jd\" (UniqueName: \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\") pod \"distinct-2-w3-2cfb80-kserve-748749867d-5tk66\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") " pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.517935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.517905    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:38.904939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:38.904912    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:26:38.906919 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:26:38.906890    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod009c5ba0_a19c_41b1_bcc9_94df2626188a.slice/crio-63cbe1235b069842c0d868c4802ac536ea3ecdbebae174e04d9b591a1dd3ab81 WatchSource:0}: Error finding container 63cbe1235b069842c0d868c4802ac536ea3ecdbebae174e04d9b591a1dd3ab81: Status 404 returned error can't find the container with id 63cbe1235b069842c0d868c4802ac536ea3ecdbebae174e04d9b591a1dd3ab81
Oct 30 23:26:39.327433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:39.327397    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" event={"ID":"009c5ba0-a19c-41b1-bcc9-94df2626188a","Type":"ContainerStarted","Data":"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"}
Oct 30 23:26:39.327433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:39.327438    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" event={"ID":"009c5ba0-a19c-41b1-bcc9-94df2626188a","Type":"ContainerStarted","Data":"63cbe1235b069842c0d868c4802ac536ea3ecdbebae174e04d9b591a1dd3ab81"}
Oct 30 23:26:39.465179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:39.465116    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podStartSLOduration=1.46510182 podStartE2EDuration="1.46510182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:26:39.463997757 +0000 UTC m=+1171.224090329" watchObservedRunningTime="2026-10-30 23:26:39.46510182 +0000 UTC m=+1171.225194391"
Oct 30 23:26:39.518674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:39.518611    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:48.519212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:48.519124    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:48.532794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:48.532765    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:26:49.423397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:26:49.423369    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:27:04.151459 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:27:04.151420    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:27:08.575735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:08.575709    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:27:08.577243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:08.577223    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:27:13.355061 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.355027    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:27:13.359410 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.359393    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.406752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.406720    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:27:13.411923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.411898    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.413341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413312    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413361    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413391    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413445    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413546    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413728    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413825    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413880    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gtk4\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.413956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.413907    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.462417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.462389    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:27:13.514871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.514836    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:27:13.515766 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.515740    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.516060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516039    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.516202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516187    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.516313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516288    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.516412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516400    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.516561 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516548    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.516686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516671    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.516821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516807    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.516928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.516901    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.517867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.517778    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.518170 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.518148    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.518361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.518346    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.518756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.518739    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gtk4\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.519274 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.519213    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swwk6\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.520029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.519482    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.520493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.520372    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.520753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.520728    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.521361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.521343    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.521945 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.521928    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.522370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.522354    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.522567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.522549    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.523024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.521264    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.523024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.522287    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.523761 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.523723    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.526993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.526954    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.579336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.579300    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gtk4\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.590414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.590383    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.624249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624162    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624258    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624304    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624326    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624390    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624438    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624485    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624519    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624579    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swwk6\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624719    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.624983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.624960    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.625225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.625193    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.625323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.625227    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.625323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.625299    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.627692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.627666    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.627903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.627770    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.674368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.674325    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:13.687712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.687652    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swwk6\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.689236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.689207    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\") pod \"e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") " pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:13.731009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:13.730974    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:14.124218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.124187    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:27:14.124389 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:27:14.124365    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84c1af7_1616_4ac1_b4fd_e440d015ab54.slice/crio-7bbc234aef12aae669df34b30205a02cea516a849943692fce418d8ecd9a86fa WatchSource:0}: Error finding container 7bbc234aef12aae669df34b30205a02cea516a849943692fce418d8ecd9a86fa: Status 404 returned error can't find the container with id 7bbc234aef12aae669df34b30205a02cea516a849943692fce418d8ecd9a86fa
Oct 30 23:27:14.127125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.127086    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.127231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.127166    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.127231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.127212    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.174812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.174789    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:27:14.176450 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:27:14.176424    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf37cb44_eaed_4066_9987_deceb2b12755.slice/crio-20685b46d20c8354667e12902f00991af11fa6e1b83134f0c0c7430de1809ae8 WatchSource:0}: Error finding container 20685b46d20c8354667e12902f00991af11fa6e1b83134f0c0c7430de1809ae8: Status 404 returned error can't find the container with id 20685b46d20c8354667e12902f00991af11fa6e1b83134f0c0c7430de1809ae8
Oct 30 23:27:14.179141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.179109    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.179230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.179172    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.179230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.179202    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:14.643211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.643166    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" event={"ID":"af37cb44-eaed-4066-9987-deceb2b12755","Type":"ContainerStarted","Data":"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"}
Oct 30 23:27:14.643734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.643269    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" event={"ID":"af37cb44-eaed-4066-9987-deceb2b12755","Type":"ContainerStarted","Data":"20685b46d20c8354667e12902f00991af11fa6e1b83134f0c0c7430de1809ae8"}
Oct 30 23:27:14.645025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.645000    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" event={"ID":"a84c1af7-1616-4ac1-b4fd-e440d015ab54","Type":"ContainerStarted","Data":"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"}
Oct 30 23:27:14.645158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.645044    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" event={"ID":"a84c1af7-1616-4ac1-b4fd-e440d015ab54","Type":"ContainerStarted","Data":"7bbc234aef12aae669df34b30205a02cea516a849943692fce418d8ecd9a86fa"}
Oct 30 23:27:14.675405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.675374    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:14.731089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.731062    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:14.765096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.765047    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podStartSLOduration=1.765033797 podStartE2EDuration="1.765033797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:27:14.762602411 +0000 UTC m=+1206.522694984" watchObservedRunningTime="2026-10-30 23:27:14.765033797 +0000 UTC m=+1206.525126368"
Oct 30 23:27:14.888356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:14.888289    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podStartSLOduration=1.888269149 podStartE2EDuration="1.888269149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:27:14.884523537 +0000 UTC m=+1206.644616110" watchObservedRunningTime="2026-10-30 23:27:14.888269149 +0000 UTC m=+1206.648361723"
Oct 30 23:27:15.676427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:15.676395    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:15.676887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:15.676446    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:15.737211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:15.737176    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:15.737501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:15.737477    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:16.675102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:16.675069    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:16.675297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:16.675115    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:16.740675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:16.739043    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:16.740675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:16.739102    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:17.675399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:17.675365    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:17.675701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:17.675673    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:17.750823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:17.743733    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:17.750823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:17.743793    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:18.696641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:18.691855    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:18.696641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:18.691936    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:18.739280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:18.739237    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:18.739541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:18.739510    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:19.675228 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:19.675187    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:19.675779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:19.675263    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:19.732826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:19.732777    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:19.733077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:19.733057    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:20.675460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:20.675420    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:20.675901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:20.675491    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:20.732031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:20.731992    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:20.732239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:20.732061    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:21.684009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.683970    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 23:27:21.685352 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.685320    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 23:27:21.741238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.741104    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:27:21.741238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.741176    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 23:27:21.953838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.953746    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:27:21.954110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:21.954079    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:27:23.105992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.105957    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:23.110992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.109767    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:23.114112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.114089    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:27:23.147109 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.147077    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:23.147854 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.147831    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:23.149092 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:23.149064    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:27:34.152505 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:27:34.152469    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:27:43.894485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.894374    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:27:43.899280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.899254    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983312    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z76t6\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983441    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983484    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983528    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983581    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983789    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983860    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983898    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:43.983980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:43.983960    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.010741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.010712    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:27:44.084783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.084744    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.084783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.084789    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.084814    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.084901    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z76t6\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.084975    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085008    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085064    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085096    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085192    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085250    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085431    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085570    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085609    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.085790 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.085771    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.087496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.087472    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.087868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.087852    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.142587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.142561    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.142898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.142873    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z76t6\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.215862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.215779    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:44.651140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.651113    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:27:44.652481 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:27:44.652452    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddd76a8_a82a_4d6c_ba36_b7565617780e.slice/crio-c50715a3fedf677ee3343e06687cd1d702086265556d9b1674152fe101165e54 WatchSource:0}: Error finding container c50715a3fedf677ee3343e06687cd1d702086265556d9b1674152fe101165e54: Status 404 returned error can't find the container with id c50715a3fedf677ee3343e06687cd1d702086265556d9b1674152fe101165e54
Oct 30 23:27:44.655377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.655340    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:44.655471 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.655421    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:44.655510 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:44.655466    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:45.167644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.164810    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" event={"ID":"fddd76a8-a82a-4d6c-ba36-b7565617780e","Type":"ContainerStarted","Data":"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"}
Oct 30 23:27:45.167644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.164881    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" event={"ID":"fddd76a8-a82a-4d6c-ba36-b7565617780e","Type":"ContainerStarted","Data":"c50715a3fedf677ee3343e06687cd1d702086265556d9b1674152fe101165e54"}
Oct 30 23:27:45.216565 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.216532    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:45.218592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.218563    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:45.218763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.218630    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:45.304641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:45.298565    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podStartSLOduration=2.298544419 podStartE2EDuration="2.298544419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:27:45.296874718 +0000 UTC m=+1237.056967290" watchObservedRunningTime="2026-10-30 23:27:45.298544419 +0000 UTC m=+1237.058636991"
Oct 30 23:27:46.218674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.217193    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:46.218674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.217255    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:46.814655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.812026    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:27:46.822012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.821987    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.841826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.841793    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.841976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.841846    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.841976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.841919    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.842049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.842030    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nq2t\" (UniqueName: \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.842212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.842197    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.842259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.842237    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.867142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.866757    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:27:46.916148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.916115    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3c9613\"/\"kube-root-ca.crt\""
Oct 30 23:27:46.918222 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.916531    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3c9613\"/\"openshift-service-ca.crt\""
Oct 30 23:27:46.926658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.925834    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3c9613\"/\"distinct-2-w2-3c9613-kserve-self-signed-certs\""
Oct 30 23:27:46.926658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.925919    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3c9613\"/\"default-dockercfg-w26f4\""
Oct 30 23:27:46.944020 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.943989    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944035    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944195    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944351    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944513    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944632    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.944901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944880    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nq2t\" (UniqueName: \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.945067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.944917    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.945148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.945059    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.946493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.946474    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:46.946660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:46.946642    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:47.059665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:47.051014    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nq2t\" (UniqueName: \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\") pod \"distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") " pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:47.136829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:47.136740    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:47.221671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:47.219709    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:47.221671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:47.219793    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:47.719064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:47.719042    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:27:48.218112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:48.218074    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:48.218329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:48.218180    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:48.225861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:48.225819    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" event={"ID":"13abeae6-c1e5-4b15-8ace-a29424ee281c","Type":"ContainerStarted","Data":"0310cfd96714ddd5ee6e40f69113ca8f677fdaa663625b85f0d7015a8f78ea2a"}
Oct 30 23:27:48.226322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:48.225877    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" event={"ID":"13abeae6-c1e5-4b15-8ace-a29424ee281c","Type":"ContainerStarted","Data":"09680d4f2fa4b276a3c73e13f087eb3650d512195f572ec85d25804c59c8d29c"}
Oct 30 23:27:48.345019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:48.344971    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podStartSLOduration=2.344956701 podStartE2EDuration="2.344956701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:27:48.343277361 +0000 UTC m=+1240.103369943" watchObservedRunningTime="2026-10-30 23:27:48.344956701 +0000 UTC m=+1240.105049272"
Oct 30 23:27:49.137230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:49.137180    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:49.216557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:49.216501    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:49.216809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:49.216596    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:50.216142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:50.216100    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:50.216678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:50.216158    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:51.216437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:51.216402    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 23:27:51.216870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:51.216469    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 23:27:52.221095 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:52.221065    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:52.221559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:52.221478    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:52.222413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:52.222396    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:27:57.137421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:57.137377    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:57.150202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:57.150174    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:57.302851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:57.302820    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:27:58.366128 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.366098    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:27:58.371276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.371257    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462220    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462275    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462488 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462463    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462585    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462680    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462715    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462753    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkg5l\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.462992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.462966    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.463054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.463040    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.478807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.478777    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:27:58.564400 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564366    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564413    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564469    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564498    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564639    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564768    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564815    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.564900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564853    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564900    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkg5l\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.564969    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.565034    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.565050    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.565235    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.565336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.565303    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.567294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.567268    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.567564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.567546    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.622742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.622677    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.622945 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.622921    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkg5l\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\") pod \"e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") " pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:58.686968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:58.686935    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:59.120337 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:27:59.120305    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d2d462_2781_4c96_b046_7150dbdea062.slice/crio-00c6d3c89e37afabd9d73b2cf4e8f9eb14a3f40d5cae1b7d51b7726c571aff4e WatchSource:0}: Error finding container 00c6d3c89e37afabd9d73b2cf4e8f9eb14a3f40d5cae1b7d51b7726c571aff4e: Status 404 returned error can't find the container with id 00c6d3c89e37afabd9d73b2cf4e8f9eb14a3f40d5cae1b7d51b7726c571aff4e
Oct 30 23:27:59.120502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.120482    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:27:59.123146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.123109    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:59.123260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.123186    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:59.123260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.123230    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:27:59.319665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.318402    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" event={"ID":"a0d2d462-2781-4c96-b046-7150dbdea062","Type":"ContainerStarted","Data":"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"}
Oct 30 23:27:59.319665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.318523    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" event={"ID":"a0d2d462-2781-4c96-b046-7150dbdea062","Type":"ContainerStarted","Data":"00c6d3c89e37afabd9d73b2cf4e8f9eb14a3f40d5cae1b7d51b7726c571aff4e"}
Oct 30 23:27:59.438549 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.438435    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podStartSLOduration=1.438415791 podStartE2EDuration="1.438415791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:27:59.436247785 +0000 UTC m=+1251.196340356" watchObservedRunningTime="2026-10-30 23:27:59.438415791 +0000 UTC m=+1251.198508363"
Oct 30 23:27:59.623570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.623526    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:27:59.632531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.631413    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.715584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.715477    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:27:59.716845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.716805    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717214 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717184    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717286    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717317    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717345    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717445    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717550    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.717894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.717871    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.718111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.718081    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597hz\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.719891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.719860    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:27:59.819096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819060    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819099    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819139    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819165    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597hz\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819273    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819351    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819406    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819427    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819444    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819500    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.819979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.819958    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.820174 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.820150    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.820238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.820223    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.820291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.820265    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.822428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.822394    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.822428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.822425    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.878477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.878437    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.886646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.878808    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597hz\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:27:59.955452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:27:59.955402    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:28:00.432168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.432136    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:28:00.432998 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:28:00.432971    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047a7acb_ecab_49ea_85ec_19ade8bf6a92.slice/crio-b1925487b15c20271ba5fd483a4b7ad55425bb8616ec23324eb9eb4dece08349 WatchSource:0}: Error finding container b1925487b15c20271ba5fd483a4b7ad55425bb8616ec23324eb9eb4dece08349: Status 404 returned error can't find the container with id b1925487b15c20271ba5fd483a4b7ad55425bb8616ec23324eb9eb4dece08349
Oct 30 23:28:00.437228 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.437192    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:00.437315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.437258    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:00.437315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.437304    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:00.693698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.691723    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:00.693698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:00.691783    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:01.356529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.356485    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" event={"ID":"047a7acb-ecab-49ea-85ec-19ade8bf6a92","Type":"ContainerStarted","Data":"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"}
Oct 30 23:28:01.356755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.356546    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" event={"ID":"047a7acb-ecab-49ea-85ec-19ade8bf6a92","Type":"ContainerStarted","Data":"b1925487b15c20271ba5fd483a4b7ad55425bb8616ec23324eb9eb4dece08349"}
Oct 30 23:28:01.621070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.614841    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podStartSLOduration=2.614819406 podStartE2EDuration="2.614819406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:28:01.561104594 +0000 UTC m=+1253.321197166" watchObservedRunningTime="2026-10-30 23:28:01.614819406 +0000 UTC m=+1253.374911979"
Oct 30 23:28:01.691643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.689046    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:01.691643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.689172    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:01.955774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.955694    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:28:01.956999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.956979    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:01.957173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:01.957153    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:02.694642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:02.691051    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:02.694642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:02.691115    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:02.956221 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:02.956135    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:02.956741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:02.956703    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:03.697152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:03.697103    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:03.697457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:03.697426    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:03.956479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:03.956389    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:03.956479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:03.956453    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:04.164149 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:28:04.164095    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:28:04.702643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:04.701283    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:04.702643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:04.701344    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:04.957401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:04.957311    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:04.957401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:04.957366    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:05.693162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:05.693118    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 23:28:05.693493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:05.693445    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 23:28:05.956534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:05.956452    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:05.956534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:05.956505    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:06.851390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:06.851352    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:28:06.851989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:06.851968    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:28:06.852723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:06.852700    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:28:06.956024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:06.955995    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:28:06.956201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:06.956041    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 23:28:08.025560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:08.025528    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:28:08.026890 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:08.026864    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:28:08.028021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:08.028001    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:28:15.057651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:15.056776    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:15.414741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:15.413724    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:15.897365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:15.895744    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:16.062309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.059740    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:16.062309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.060652    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:28:16.352913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.316909    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:16.452686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.420733    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:16.625389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.624940    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:28:16.864142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.859214    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:28:16.871643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:16.871584    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:28:34.152070 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:28:34.152024    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:28:36.898643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:36.879593    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:37.304467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:37.304419    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:38.070647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.067474    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 23:28:38.179337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.179290    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/health\": context deadline exceeded"
Oct 30 23:28:38.262656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.261484    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:28:38.262656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.261583    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:38.321700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.317035    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:38.321700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.319857    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:28:38.359649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.352748    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:28:38.359649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.352815    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:38.949215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.949130    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:28:38.964023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:38.963992    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:28:43.439208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.439173    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:28:43.444816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.444798    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.480867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.480832    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.481091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.481071    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c992k\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.481357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.481339    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.481600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.481581    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.482693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.482664    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.482838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.482822    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.482992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.482975    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.483173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.483159    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.483279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.483266    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.551587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.551556    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:28:43.584598 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584566    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.584802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584609    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c992k\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.584802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584712    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.584928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584809    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.584928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584863    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.584928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584908    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.585097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.584973    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.585097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.585032    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.585097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.585038    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.585271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.585097    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.585486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.585461    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.591934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.586224    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.591934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.586481    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.592113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.587160    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.592113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.588270    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.592113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.589451    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.643018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.642983    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.643156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.643111    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c992k\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:43.759599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:43.759565    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:44.204688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.203339    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:28:44.211784 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:28:44.211756    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71e5032_d316_4096_be0b_2ac0ca694265.slice/crio-7861b76cd179f14e70736a6ddd3940db539b988f1b93272d892da33f1277e29c WatchSource:0}: Error finding container 7861b76cd179f14e70736a6ddd3940db539b988f1b93272d892da33f1277e29c: Status 404 returned error can't find the container with id 7861b76cd179f14e70736a6ddd3940db539b988f1b93272d892da33f1277e29c
Oct 30 23:28:44.214252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.214215    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:44.214354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.214306    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:44.214395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.214353    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:44.519215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.519176    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" event={"ID":"f71e5032-d316-4096-be0b-2ac0ca694265","Type":"ContainerStarted","Data":"4f359aa24b97801bc72af2efe8717ed54fb4532e8f278ba2de991641a7050403"}
Oct 30 23:28:44.519714 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.519245    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" event={"ID":"f71e5032-d316-4096-be0b-2ac0ca694265","Type":"ContainerStarted","Data":"7861b76cd179f14e70736a6ddd3940db539b988f1b93272d892da33f1277e29c"}
Oct 30 23:28:44.645009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.644954    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podStartSLOduration=1.64494115 podStartE2EDuration="1.64494115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:28:44.641805695 +0000 UTC m=+1296.401898268" watchObservedRunningTime="2026-10-30 23:28:44.64494115 +0000 UTC m=+1296.405033791"
Oct 30 23:28:44.711429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.711396    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:28:44.715973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.715947    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.722411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.722385    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:28:44.726940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.726797    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.756480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.756445    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:28:44.760119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.760100    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:44.795711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.795582    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:28:44.811512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.811471    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.811877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.811849    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.812038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812020    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5k7\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.812179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812160    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.812309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812293    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.812475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812458    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.812643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812609    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.812787 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812770    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.812928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.812912    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.813046 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813032    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.813251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813233    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.813378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813363    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.813553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813528    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.813646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813598    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.813730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813715    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.813769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813751    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdd46\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.813800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813786    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.813833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.813825    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915187    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915234    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915300    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915323    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5k7\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915358    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915388    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915460    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915498    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915566    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915635    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915668    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.915943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915790    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915801    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915871    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915908    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.915943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.915919    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.916195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916004    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.916195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916059    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.916195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916094    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdd46\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.916439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916419    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.917060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916718    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.917060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916854    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.917060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.916990    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.917060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.917014    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.917343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.917164    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.917564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.917531    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.917721 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.917698    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.918338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.918254    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.918972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.918948    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.921057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.920997    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.921057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.921014    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.921442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.921403    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.976435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.976403    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:44.976612 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.976508    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5k7\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.976612 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.976539    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:44.976780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:44.976697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdd46\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\") pod \"e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") " pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:45.034454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.034422    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:45.043115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.042965    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:45.534417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.534384    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:28:45.536404 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:28:45.536377    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb80e4e5_6315_4d39_a24b_35e9c7091e33.slice/crio-d5a1efb94c88ff4f1a49a4dc462feaf140474a3bf5035d10fcfceb32a65f400a WatchSource:0}: Error finding container d5a1efb94c88ff4f1a49a4dc462feaf140474a3bf5035d10fcfceb32a65f400a: Status 404 returned error can't find the container with id d5a1efb94c88ff4f1a49a4dc462feaf140474a3bf5035d10fcfceb32a65f400a
Oct 30 23:28:45.538718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.538683    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.538786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.538753    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.538832 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.538783    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.615463 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.612350    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:28:45.620495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.619673    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.620495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.619764    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.620495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.619807    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:28:45.761785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.761747    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:45.761918 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:45.761805    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:46.632640 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.631739    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" event={"ID":"54b25369-0807-45c6-b8a0-4ae6feb8b74c","Type":"ContainerStarted","Data":"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"}
Oct 30 23:28:46.632640 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.631849    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" event={"ID":"54b25369-0807-45c6-b8a0-4ae6feb8b74c","Type":"ContainerStarted","Data":"62e36b18578cd4be7d3028942e6e31d408e3e81913e297552cd64174dd29e9ca"}
Oct 30 23:28:46.673146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.672726    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" event={"ID":"bb80e4e5-6315-4d39-a24b-35e9c7091e33","Type":"ContainerStarted","Data":"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"}
Oct 30 23:28:46.673146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.672788    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" event={"ID":"bb80e4e5-6315-4d39-a24b-35e9c7091e33","Type":"ContainerStarted","Data":"d5a1efb94c88ff4f1a49a4dc462feaf140474a3bf5035d10fcfceb32a65f400a"}
Oct 30 23:28:46.762096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.762049    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:46.762391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.762364    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:46.824872 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.824804    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podStartSLOduration=2.82478635 podStartE2EDuration="2.82478635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:28:46.802992582 +0000 UTC m=+1298.563085165" watchObservedRunningTime="2026-10-30 23:28:46.82478635 +0000 UTC m=+1298.584878925"
Oct 30 23:28:46.939404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:46.939267    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podStartSLOduration=2.939250941 podStartE2EDuration="2.939250941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:28:46.938102478 +0000 UTC m=+1298.698195050" watchObservedRunningTime="2026-10-30 23:28:46.939250941 +0000 UTC m=+1298.699343514"
Oct 30 23:28:47.035709 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.035673    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:47.040779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.040745    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:47.041009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.040983    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:47.052846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.052812    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:47.055073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.055042    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:47.055317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.055292    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:47.774080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.774043    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:47.774760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:47.774711    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:48.072844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.071315    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:48.072844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.071388    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:48.072844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.071925    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:48.072844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.071968    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:48.762997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.762355    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:48.762997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:48.762431    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:49.065742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.065011    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:49.065742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.065073    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:49.067313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.067284    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:49.067496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.067472    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:49.771271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.771047    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:49.771271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:49.771127    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:50.041973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.041877    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:50.042232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.042203    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:50.053791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.053758    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:50.054050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.054026    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:50.760530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.760493    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:28:50.760972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:50.760543    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 23:28:51.056533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:51.054482    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:51.056533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:51.054539    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:51.057018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:51.056937    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:51.057018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:51.056987    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:52.048083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.048041    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:52.048728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.048693    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:52.049684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.049664    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:52.049843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.049824    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:52.484893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.481012    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:52.484893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.482586    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:52.485372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:52.485325    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:28:53.035589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:53.035553    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:28:53.035797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:53.035637    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 23:28:53.044016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:53.043989    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:28:53.044161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:53.044040    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 23:28:54.040246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.040217    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:54.040783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.040599    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:54.041387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.041366    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:28:54.047882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.047833    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:54.048229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.048209    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:54.049045 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:54.049029    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:28:57.070824 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.070784    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:28:57.071227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.071038    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy" containerID="cri-o://0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2" gracePeriod=30
Oct 30 23:28:57.073999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.073966    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:28:57.074239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.074213    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy" containerID="cri-o://fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5" gracePeriod=30
Oct 30 23:28:57.077019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.076993    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:28:57.077186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:57.077169    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy" containerID="cri-o://11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108" gracePeriod=30
Oct 30 23:28:59.488870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.488836    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:28:59.493447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.493426    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.605128 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.605087    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:28:59.656340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656297    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656545 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656427    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrsn\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656545 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656524    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656575    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656776    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656812    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.656964 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.656934    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.657044 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.657018    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.657194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.657146    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758215    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrsn\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758285    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758326    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758467    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758497    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758549    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758631    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758739    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.758891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.758820    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.759428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.759396    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.759923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.759896    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.760521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.760499    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.760986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.760965    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.761395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.761373    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.761662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.761632    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.762242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.762215    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.816491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.816463    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:28:59.816672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:28:59.816604    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrsn\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\") pod \"e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") " pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:00.108585 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.108481    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:00.145839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.145808    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:29:00.150648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.150624    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.225543 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.224699    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:29:00.266962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.266923    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267050    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267160    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpr98\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267305    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267338    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267370    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267512    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267606    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.267705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.267694    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369581    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpr98\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369756    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369787    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369828    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369868    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369932    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.369985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.369978    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370030    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370096    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370294    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370475    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370564    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370716    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.370923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.370898    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.372291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.372267    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.372670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.372654    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.426992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.426955    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.427171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.427151    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpr98\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.470085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.470055    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:00.562659 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:00.560071    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd375ce5c_2079_4d10_b676_65ff5415257c.slice/crio-ecd7744350858548b887a297c12f2f0de990d121475c7a5d55fe11a21cce0bca WatchSource:0}: Error finding container ecd7744350858548b887a297c12f2f0de990d121475c7a5d55fe11a21cce0bca: Status 404 returned error can't find the container with id ecd7744350858548b887a297c12f2f0de990d121475c7a5d55fe11a21cce0bca
Oct 30 23:29:00.563272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.563180    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.563272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.563243    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.563272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.563271    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.565557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.565275    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:29:00.863190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.863154    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:29:00.863656 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:00.863629    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef657dd_653f_4443_891c_5f7fdb795d8a.slice/crio-705f5c7be1f0b6ca9bf21c4cb37d61dee0248f3de6475d61e4c3feaa36e2bfc1 WatchSource:0}: Error finding container 705f5c7be1f0b6ca9bf21c4cb37d61dee0248f3de6475d61e4c3feaa36e2bfc1: Status 404 returned error can't find the container with id 705f5c7be1f0b6ca9bf21c4cb37d61dee0248f3de6475d61e4c3feaa36e2bfc1
Oct 30 23:29:00.867257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.867217    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.867344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.867301    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.867399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.867347    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:00.992968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.992926    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" event={"ID":"7ef657dd-653f-4443-891c-5f7fdb795d8a","Type":"ContainerStarted","Data":"cc1eeae8967910c3bfbaadc78c326fc60c0a9ea29fbfb14bf079dda187942748"}
Oct 30 23:29:00.993134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.993001    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" event={"ID":"7ef657dd-653f-4443-891c-5f7fdb795d8a","Type":"ContainerStarted","Data":"705f5c7be1f0b6ca9bf21c4cb37d61dee0248f3de6475d61e4c3feaa36e2bfc1"}
Oct 30 23:29:00.995217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.995178    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" event={"ID":"d375ce5c-2079-4d10-b676-65ff5415257c","Type":"ContainerStarted","Data":"38b14f4d307181554ad904ce2fd12cf9ee31298f65378719bbbc9415538b3a24"}
Oct 30 23:29:00.995362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:00.995229    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" event={"ID":"d375ce5c-2079-4d10-b676-65ff5415257c","Type":"ContainerStarted","Data":"ecd7744350858548b887a297c12f2f0de990d121475c7a5d55fe11a21cce0bca"}
Oct 30 23:29:01.109364 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.109335    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:01.114988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.114948    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:01.115188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.115002    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:01.116193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.116149    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podStartSLOduration=1.116134853 podStartE2EDuration="1.116134853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:01.115290743 +0000 UTC m=+1312.875383315" watchObservedRunningTime="2026-10-30 23:29:01.116134853 +0000 UTC m=+1312.876227425"
Oct 30 23:29:01.244444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.244393    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podStartSLOduration=2.244378773 podStartE2EDuration="2.244378773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:01.241238735 +0000 UTC m=+1313.001331307" watchObservedRunningTime="2026-10-30 23:29:01.244378773 +0000 UTC m=+1313.004471343"
Oct 30 23:29:01.471653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.471372    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:01.472828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.472765    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:01.472984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:01.472838    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:02.131267 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.130754    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:02.131267 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.130816    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:02.470920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.470435    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:02.470920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.470486    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:02.647485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.647414    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:29:02.773423 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.773389    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.773545 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.773475    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.774154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774119    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:29:02.774291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774139    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.774291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774207    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.774405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774307    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.774405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774374    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.774502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774417    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774510    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774779    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774837    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\") pod \"490deeea-16f2-46be-8ddb-9e25f9dd3241\" (UID: \"490deeea-16f2-46be-8ddb-9e25f9dd3241\") "
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774887    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.774916    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775100    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:29:02.775284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775251    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.775741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775650    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.775741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775672    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.775741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775688    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.775741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775705    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.775741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.775720    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490deeea-16f2-46be-8ddb-9e25f9dd3241-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.776919 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.776900    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:29:02.778322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.778301    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.820664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.819830    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "kube-api-access-z8mgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:02.855882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.824855    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token" pod "490deeea-16f2-46be-8ddb-9e25f9dd3241" (UID: "490deeea-16f2-46be-8ddb-9e25f9dd3241"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:02.875142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.875110    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877369    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877455    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877511    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877553    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877584    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.877883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877823    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.878300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.877946    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.878300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.878246    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:29:02.885768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.885720    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.889723    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.889784    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.889829    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\") pod \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\" (UID: \"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec\") "
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890857    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890881    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8mgw\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-kube-api-access-z8mgw\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890897    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890911    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890924    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890960    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.890975    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490deeea-16f2-46be-8ddb-9e25f9dd3241-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:02.926280 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.905745    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.965666 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.963463    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:02.967604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.967570    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:02.967604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.967583    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:29:02.967823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.967672    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "kube-api-access-hbz7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:02.968702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:02.968679    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy" pod "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" (UID: "43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.061171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.060220    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.061547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.061499    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.061768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.061751    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.061999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.061982    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.062134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.062119    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.062309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.062292    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.062450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.062434    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.062630 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.062594    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.062747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.062732    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\") pod \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\" (UID: \"e0aa0e58-87d0-4009-87e6-a0171d7e5599\") "
Oct 30 23:29:03.063426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.063154    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.066912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.063458    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.066912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.063672    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.066912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.063861    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.066912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.064012    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:29:03.070589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070543    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "kube-api-access-jdck5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070922    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070941    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070953    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070962    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070978    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070987    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.070996    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.071004    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.071016    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.071025    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbz7z\" (UniqueName: \"kubernetes.io/projected/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec-kube-api-access-hbz7z\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.071034    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.072718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.071122    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:03.073867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.073385    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:29:03.074137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.074112    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo" pod "e0aa0e58-87d0-4009-87e6-a0171d7e5599" (UID: "e0aa0e58-87d0-4009-87e6-a0171d7e5599"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:29:03.076296 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.076259    6126 generic.go:356] "Generic (PLEG): container finished" podID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerID="0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2" exitCode=0
Oct 30 23:29:03.076489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.076467    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" event={"ID":"e0aa0e58-87d0-4009-87e6-a0171d7e5599","Type":"ContainerDied","Data":"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"}
Oct 30 23:29:03.076610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.076567    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4" event={"ID":"e0aa0e58-87d0-4009-87e6-a0171d7e5599","Type":"ContainerDied","Data":"7a618cb04cb4109b194bc0f940a8ce9d2296c672c526a2f439711f108a921071"}
Oct 30 23:29:03.076610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.076636    6126 scope.go:122] "RemoveContainer" containerID="0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"
Oct 30 23:29:03.076954 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.076834    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"
Oct 30 23:29:03.118643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.078882    6126 generic.go:356] "Generic (PLEG): container finished" podID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerID="fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5" exitCode=0
Oct 30 23:29:03.164643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.163241    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" event={"ID":"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec","Type":"ContainerDied","Data":"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"}
Oct 30 23:29:03.164643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.163324    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt" event={"ID":"43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec","Type":"ContainerDied","Data":"a8946d767cb9886c7cd74d2978a6167c0b9cd8db8e3a9e66d9561c97f90c87d9"}
Oct 30 23:29:03.164643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.163360    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175033    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175119    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175460    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175485    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175507    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdck5\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-kube-api-access-jdck5\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.176735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.175528    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aa0e58-87d0-4009-87e6-a0171d7e5599-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:03.248764 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.248723    6126 generic.go:356] "Generic (PLEG): container finished" podID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerID="11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108" exitCode=0
Oct 30 23:29:03.250742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.250676    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" event={"ID":"490deeea-16f2-46be-8ddb-9e25f9dd3241","Type":"ContainerDied","Data":"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"}
Oct 30 23:29:03.250882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.250755    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn" event={"ID":"490deeea-16f2-46be-8ddb-9e25f9dd3241","Type":"ContainerDied","Data":"cef9bd7a4518908a6c11efb78fe9ab51e0bbca2a21c9959aac1b44ccaa47e208"}
Oct 30 23:29:03.250882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.250874    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"
Oct 30 23:29:03.261823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.261800    6126 scope.go:122] "RemoveContainer" containerID="0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"
Oct 30 23:29:03.262377 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:03.262351    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2\": container with ID starting with 0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2 not found: ID does not exist" containerID="0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"
Oct 30 23:29:03.262534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.262507    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2"} err="failed to get container status \"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2\": rpc error: code = NotFound desc = could not find container \"0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2\": container with ID starting with 0fa724c598e49e58eab991f63d19cbe8eebb7fe5bcd5f2625094fdcea7395dc2 not found: ID does not exist"
Oct 30 23:29:03.262660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.262646    6126 scope.go:122] "RemoveContainer" containerID="fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"
Oct 30 23:29:03.364389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.361893    6126 scope.go:122] "RemoveContainer" containerID="fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"
Oct 30 23:29:03.365120 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:03.365032    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5\": container with ID starting with fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5 not found: ID does not exist" containerID="fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"
Oct 30 23:29:03.365120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.365079    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5"} err="failed to get container status \"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5\": rpc error: code = NotFound desc = could not find container \"fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5\": container with ID starting with fb3099a9c57897d77585d47c7611bb9b4528be2a02f1a997e5bfd297c803eec5 not found: ID does not exist"
Oct 30 23:29:03.365120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.365106    6126 scope.go:122] "RemoveContainer" containerID="11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"
Oct 30 23:29:03.453780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.453690    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:29:03.459173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.459141    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-sfdgt"]
Oct 30 23:29:03.464671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.464602    6126 scope.go:122] "RemoveContainer" containerID="11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"
Oct 30 23:29:03.465286 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:03.465256    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108\": container with ID starting with 11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108 not found: ID does not exist" containerID="11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"
Oct 30 23:29:03.465393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.465298    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108"} err="failed to get container status \"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108\": rpc error: code = NotFound desc = could not find container \"11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108\": container with ID starting with 11d075bfab4d335fbd318c64a395f9be08708728c26cec9755180bfcea800108 not found: ID does not exist"
Oct 30 23:29:03.470756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.470720    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:03.470911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.470892    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:03.570960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.570929    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:29:03.574354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.574331    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-qvcb4"]
Oct 30 23:29:03.722738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.722684    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:29:03.745703 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:03.743293    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-xrgdn"]
Oct 30 23:29:04.152382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.152293    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:04.152686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.152607    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:04.250467 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:04.249275    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:29:04.446893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.446811    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" path="/var/lib/kubelet/pods/43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec/volumes"
Oct 30 23:29:04.447419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.447403    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" path="/var/lib/kubelet/pods/490deeea-16f2-46be-8ddb-9e25f9dd3241/volumes"
Oct 30 23:29:04.447882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.447868    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" path="/var/lib/kubelet/pods/e0aa0e58-87d0-4009-87e6-a0171d7e5599/volumes"
Oct 30 23:29:04.470765 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.470733    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:04.470885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:04.470785    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:05.113643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:05.112944    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:05.113643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:05.113005    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:05.470828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:05.470788    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:05.471314 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:05.470856    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:06.113644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:06.113031    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:06.113644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:06.113095    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:06.471099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:06.471057    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:06.471509 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:06.471125    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:07.109341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:07.109293    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 23:29:07.109566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:07.109362    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 23:29:07.470644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:07.470590    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:29:07.470809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:07.470673    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 23:29:08.200105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.200071    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:08.200689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.200640    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:08.205170 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.205135    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:29:08.593632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.593582    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:08.594223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.594194    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:08.595051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:08.595029    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:29:14.861206 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:14.861161    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 23:29:14.897307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:14.897250    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 23:29:14.964651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:14.941812    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:14.975653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:14.973718    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:15.891757 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.891718    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:29:15.911518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.911482    6126 cpu_manager.go:414] "containerMap: removing container" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy"
Oct 30 23:29:15.911779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.911758    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy"
Oct 30 23:29:15.911923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.911911    6126 cpu_manager.go:414] "containerMap: removing container" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy"
Oct 30 23:29:15.912016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.912003    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy"
Oct 30 23:29:15.912218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.912204    6126 cpu_manager.go:414] "containerMap: removing container" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy"
Oct 30 23:29:15.912318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.912306    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy"
Oct 30 23:29:15.988641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.988044    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:16.020192 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.020141    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:16.022220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:15.916567    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:16.023283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.023254    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:16.134864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.098387    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="43ae6a55-ce8c-4ce5-a3f9-7eb6312905ec" containerName="istio-proxy"
Oct 30 23:29:16.173787 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.135156    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="490deeea-16f2-46be-8ddb-9e25f9dd3241" containerName="istio-proxy"
Oct 30 23:29:16.240993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.240853    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0aa0e58-87d0-4009-87e6-a0171d7e5599" containerName="istio-proxy"
Oct 30 23:29:16.241685 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.023116    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:16.391738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.349713    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:29:16.391738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.358353    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.611645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.535741    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:29:16.611645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.535867    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621466    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621529    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621556    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621608    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621671    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqwnb\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621867    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621909    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.621994    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.674551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.622171    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.825741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.825705    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.891794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.891685    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.897782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.897747    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.903652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.898029    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.904019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.903896    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.904217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.904183    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqwnb\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.973665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.973611    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.973979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.973930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.974223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.974204    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.986052 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.986014    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.986255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.908137    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.986358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.907822    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.991091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.991064    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:16.994698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:16.826349    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.031969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.031926    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:17.037933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.032428    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 23:29:17.076443 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.076408    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqwnb\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.169311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.169227    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.169823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.169778    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 23:29:17.207819 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.207779    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.258389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.258353    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\") pod \"e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") " pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.277183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.277153    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:29:17.278916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.278894    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:29:17.342655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.342077    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:17.382168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.382127    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Oct 30 23:29:17.772849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.772808    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:17.812308 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.812266    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:17.831748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.779669    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:29:17.835645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:17.832040    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:29:18.105606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:18.040766    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:18.183495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:18.183453    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:18.184090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:18.184060    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/health\": context deadline exceeded"
Oct 30 23:29:18.795116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:18.791937    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:19.014876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:18.978929    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:29:19.014876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.010298    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:29:19.162101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.162017    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7384-6b303d"]
Oct 30 23:29:19.173985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.173959    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:19.216298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.216268    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7384-6b303d"]
Oct 30 23:29:19.229200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.229166    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qwr4w\""
Oct 30 23:29:19.257038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.257006    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t76j\" (UniqueName: \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\") pod \"test-curl-7384-6b303d\" (UID: \"2d774bfc-cf09-4ba4-83eb-2f95a212b61e\") " pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:19.337652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.337600    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:29:19.338224 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:19.338199    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad00c7d_34c5_42d8_86f9_3aa430a75039.slice/crio-80eec07df4cf845a23c80693d42ea37c44bfa18c73a16451cb4aef95cb3ca088 WatchSource:0}: Error finding container 80eec07df4cf845a23c80693d42ea37c44bfa18c73a16451cb4aef95cb3ca088: Status 404 returned error can't find the container with id 80eec07df4cf845a23c80693d42ea37c44bfa18c73a16451cb4aef95cb3ca088
Oct 30 23:29:19.341845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.341792    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:19.342102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.342079    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:19.342317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.342293    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:19.361765 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.361738    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t76j\" (UniqueName: \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\") pod \"test-curl-7384-6b303d\" (UID: \"2d774bfc-cf09-4ba4-83eb-2f95a212b61e\") " pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:19.419681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.419596    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t76j\" (UniqueName: \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\") pod \"test-curl-7384-6b303d\" (UID: \"2d774bfc-cf09-4ba4-83eb-2f95a212b61e\") " pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:19.488903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.488871    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:19.927313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.927282    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7384-6b303d"]
Oct 30 23:29:19.931611 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.931592    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:29:19.960765 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.960734    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" event={"ID":"9ad00c7d-34c5-42d8-86f9-3aa430a75039","Type":"ContainerStarted","Data":"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"}
Oct 30 23:29:19.960929 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.960795    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" event={"ID":"9ad00c7d-34c5-42d8-86f9-3aa430a75039","Type":"ContainerStarted","Data":"80eec07df4cf845a23c80693d42ea37c44bfa18c73a16451cb4aef95cb3ca088"}
Oct 30 23:29:19.962143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:19.962117    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7384-6b303d" event={"ID":"2d774bfc-cf09-4ba4-83eb-2f95a212b61e","Type":"ContainerStarted","Data":"c4cc826bdfd69391b4366c21cfa480ec0eeb43561839af1e0046cf22a8788c18"}
Oct 30 23:29:20.081249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:20.081199    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podStartSLOduration=5.081182139 podStartE2EDuration="5.081182139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:20.079100186 +0000 UTC m=+1331.839192997" watchObservedRunningTime="2026-10-30 23:29:20.081182139 +0000 UTC m=+1331.841274711"
Oct 30 23:29:20.356933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:20.356906    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:20.357986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:20.357965    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:20.358099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:20.358008    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:21.351821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:21.351789    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:21.352056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:21.351848    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:21.977239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:21.977202    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7384-6b303d" event={"ID":"2d774bfc-cf09-4ba4-83eb-2f95a212b61e","Type":"ContainerStarted","Data":"f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853"}
Oct 30 23:29:22.100642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:22.095287    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7384-6b303d" podStartSLOduration=1.7639043399999998 podStartE2EDuration="3.095265489s" totalImagesPullingTime="1.331361149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:22.093790167 +0000 UTC m=+1333.853882725" watchObservedRunningTime="2026-10-30 23:29:22.095265489 +0000 UTC m=+1333.855358060"
Oct 30 23:29:22.351695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:22.351577    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:22.351695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:22.351674    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:23.351155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.351123    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:23.351523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.351183    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:23.627852 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.627763    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7384-6b303d"]
Oct 30 23:29:23.629107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.629083    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7384-6b303d"]
Oct 30 23:29:23.829663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.828105    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7384-9927ce"]
Oct 30 23:29:23.829663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.829174    6126 cpu_manager.go:414] "containerMap: removing container" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" containerName="test-curl-7384-6b303d"
Oct 30 23:29:23.829663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.829193    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" containerName="test-curl-7384-6b303d"
Oct 30 23:29:23.829663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.829296    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" containerName="test-curl-7384-6b303d"
Oct 30 23:29:23.833107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.833085    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:23.852234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.852210    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7384-9927ce"]
Oct 30 23:29:23.873723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.873604    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2wm7\" (UniqueName: \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\") pod \"test-curl-7384-9927ce\" (UID: \"9594f8d8-a519-4f5d-968a-912afe8ab88e\") " pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:23.975994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:23.975957    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2wm7\" (UniqueName: \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\") pod \"test-curl-7384-9927ce\" (UID: \"9594f8d8-a519-4f5d-968a-912afe8ab88e\") " pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:24.027737 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.027679    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7384-6b303d" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" containerName="test-curl-7384-6b303d" containerID="cri-o://f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853" gracePeriod=2
Oct 30 23:29:24.033934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.033910    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2wm7\" (UniqueName: \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\") pod \"test-curl-7384-9927ce\" (UID: \"9594f8d8-a519-4f5d-968a-912afe8ab88e\") " pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:24.104642 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:24.102897    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-6b303d\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:24.145832 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.145800    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:24.351126 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.351092    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:24.351293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.351146    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:24.563830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:24.563797    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7384-9927ce"]
Oct 30 23:29:24.565315 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:24.564679    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9594f8d8_a519_4f5d_968a_912afe8ab88e.slice/crio-35d6d6e3333bf9fd00f9154ba89798d1dee369ec8568d9ce4f4fd77cdc0a1504 WatchSource:0}: Error finding container 35d6d6e3333bf9fd00f9154ba89798d1dee369ec8568d9ce4f4fd77cdc0a1504: Status 404 returned error can't find the container with id 35d6d6e3333bf9fd00f9154ba89798d1dee369ec8568d9ce4f4fd77cdc0a1504
Oct 30 23:29:25.035602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:25.035568    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7384-9927ce" event={"ID":"9594f8d8-a519-4f5d-968a-912afe8ab88e","Type":"ContainerStarted","Data":"eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6"}
Oct 30 23:29:25.035818 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:25.035629    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7384-9927ce" event={"ID":"9594f8d8-a519-4f5d-968a-912afe8ab88e","Type":"ContainerStarted","Data":"35d6d6e3333bf9fd00f9154ba89798d1dee369ec8568d9ce4f4fd77cdc0a1504"}
Oct 30 23:29:25.156080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:25.156022    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7384-9927ce" podStartSLOduration=2.156008705 podStartE2EDuration="2.156008705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:25.154059027 +0000 UTC m=+1336.914151599" watchObservedRunningTime="2026-10-30 23:29:25.156008705 +0000 UTC m=+1336.916101320"
Oct 30 23:29:25.351863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:25.351782    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:25.351863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:25.351831    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:26.299849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.299784    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:26.351273 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.351238    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:29:26.351424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.351302    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 23:29:26.450294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.450261    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\" (UniqueName: \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\") pod \"2d774bfc-cf09-4ba4-83eb-2f95a212b61e\" (UID: \"2d774bfc-cf09-4ba4-83eb-2f95a212b61e\") "
Oct 30 23:29:26.452840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.452815    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j" pod "2d774bfc-cf09-4ba4-83eb-2f95a212b61e" (UID: "2d774bfc-cf09-4ba4-83eb-2f95a212b61e"). InnerVolumeSpecName "kube-api-access-7t76j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:26.552307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.552206    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t76j\" (UniqueName: \"kubernetes.io/projected/2d774bfc-cf09-4ba4-83eb-2f95a212b61e-kube-api-access-7t76j\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:26.671724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.670859    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7384-9927ce"]
Oct 30 23:29:26.676761 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:26.676708    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7384-9927ce"]
Oct 30 23:29:27.056920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.056885    6126 generic.go:356] "Generic (PLEG): container finished" podID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" containerID="f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853" exitCode=137
Oct 30 23:29:27.057162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.057131    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7384-9927ce" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" containerName="test-curl-7384-9927ce" containerID="cri-o://eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6" gracePeriod=2
Oct 30 23:29:27.057299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.057284    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-6b303d"
Oct 30 23:29:27.058313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.057986    6126 scope.go:122] "RemoveContainer" containerID="f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853"
Oct 30 23:29:27.068404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.068384    6126 scope.go:122] "RemoveContainer" containerID="f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853"
Oct 30 23:29:27.068693 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:27.068664    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853\": container with ID starting with f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853 not found: ID does not exist" containerID="f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853"
Oct 30 23:29:27.068767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.068706    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853"} err="failed to get container status \"f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853\": rpc error: code = NotFound desc = could not find container \"f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853\": container with ID starting with f3e03fefbf068d801c41a70d2e3cff7e55cfec48dd12d970bf3c6f9e0d715853 not found: ID does not exist"
Oct 30 23:29:27.109591 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:27.109551    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-9927ce\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:27.160910 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:27.160878    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-9927ce\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:27.355772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.355698    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:27.355988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.355965    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:27.356853 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:27.356831    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:29:27.580091 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:27.580052    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-9927ce\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:27.631818 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:27.631741    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-9927ce\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:28.407842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:28.407813    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d774bfc-cf09-4ba4-83eb-2f95a212b61e" path="/var/lib/kubelet/pods/2d774bfc-cf09-4ba4-83eb-2f95a212b61e/volumes"
Oct 30 23:29:28.454773 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:28.454737    6126 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7384-9927ce\" is forbidden: User \"system:node:ip-10-0-133-110.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-110.us-west-1.compute.internal' and this object" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:29.034437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.034391    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:29:29.035477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.035454    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" containerName="test-curl-7384-9927ce"
Oct 30 23:29:29.035542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.035481    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" containerName="test-curl-7384-9927ce"
Oct 30 23:29:29.035679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.035664    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" containerName="test-curl-7384-9927ce"
Oct 30 23:29:29.040670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.040649    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.242774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.115929    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-49d07c83-openshift-default-dockercfg-h2ghx\""
Oct 30 23:29:29.283583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.282735    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286134    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286295    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286346    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286380    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286459    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286508    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286559    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286642    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2qh\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.287366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.286709    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.393710    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.393784    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.393819    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.393906    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.393962    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.394013    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.394077    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2qh\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.394145    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.394261    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.394854    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.395129    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.396842    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.397053    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.402641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.397282    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.425643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.423991    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.451595 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.451561    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.456908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.456877    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2qh\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.457143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.457049    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\") pod \"e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") " pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.593454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.593424    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:29.627775 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.627739    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\" (UniqueName: \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\") pod \"9594f8d8-a519-4f5d-968a-912afe8ab88e\" (UID: \"9594f8d8-a519-4f5d-968a-912afe8ab88e\") "
Oct 30 23:29:29.630105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.630074    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7" pod "9594f8d8-a519-4f5d-968a-912afe8ab88e" (UID: "9594f8d8-a519-4f5d-968a-912afe8ab88e"). InnerVolumeSpecName "kube-api-access-x2wm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:29:29.677605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.677567    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:29.731141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:29.731025    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2wm7\" (UniqueName: \"kubernetes.io/projected/9594f8d8-a519-4f5d-968a-912afe8ab88e-kube-api-access-x2wm7\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:29:30.131391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.131357    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:29:30.169307 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:30.169280    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6b8111_dc7a_4bc5_be8d_f173845d275d.slice/crio-362911bf57c1a294ba5719b035ea1098b5621e474a9fc776f4c500fea62a1b9e WatchSource:0}: Error finding container 362911bf57c1a294ba5719b035ea1098b5621e474a9fc776f4c500fea62a1b9e: Status 404 returned error can't find the container with id 362911bf57c1a294ba5719b035ea1098b5621e474a9fc776f4c500fea62a1b9e
Oct 30 23:29:30.171984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.171947    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:30.172105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.172029    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:30.172105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.172075    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:30.308179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.308139    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerStarted","Data":"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"}
Oct 30 23:29:30.308388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.308212    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerStarted","Data":"362911bf57c1a294ba5719b035ea1098b5621e474a9fc776f4c500fea62a1b9e"}
Oct 30 23:29:30.309887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.309858    6126 generic.go:356] "Generic (PLEG): container finished" podID="9594f8d8-a519-4f5d-968a-912afe8ab88e" containerID="eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6" exitCode=137
Oct 30 23:29:30.310018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.309903    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7384-9927ce"
Oct 30 23:29:30.310018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.309922    6126 scope.go:122] "RemoveContainer" containerID="eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6"
Oct 30 23:29:30.322550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.322526    6126 scope.go:122] "RemoveContainer" containerID="eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6"
Oct 30 23:29:30.322935 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:30.322907    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6\": container with ID starting with eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6 not found: ID does not exist" containerID="eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6"
Oct 30 23:29:30.323032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.322947    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6"} err="failed to get container status \"eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6\": rpc error: code = NotFound desc = could not find container \"eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6\": container with ID starting with eb8a18a276a13e612b83c115b30d8108a506a8c9a31d795b6575d472bce2bab6 not found: ID does not exist"
Oct 30 23:29:30.410297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.410211    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9594f8d8-a519-4f5d-968a-912afe8ab88e" path="/var/lib/kubelet/pods/9594f8d8-a519-4f5d-968a-912afe8ab88e/volumes"
Oct 30 23:29:30.432824 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.432772    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podStartSLOduration=2.432757947 podStartE2EDuration="2.432757947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:30.429707171 +0000 UTC m=+1342.189799741" watchObservedRunningTime="2026-10-30 23:29:30.432757947 +0000 UTC m=+1342.192850518"
Oct 30 23:29:30.678244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:30.678122    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:31.685368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:31.685332    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:32.327130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:32.327094    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:32.328051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:32.328032    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:29:34.156198 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:29:34.156156    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:29:36.088760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.088725    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:29:36.112686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.112653    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.209369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.209332    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2b6c82a0-openshift-default-dockercfg-xxxck\""
Oct 30 23:29:36.266781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.262565    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:29:36.291766 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.291706    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.291830    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.291888    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.291977    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd8b5\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.292021    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.292061    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.292214    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.292249    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.292390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.292356    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.393833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.393736    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.393833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.393776    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.393855    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.393938    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.393999    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394033    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394108    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd8b5\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394145    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394173    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394637    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394686    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394884    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.394984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.394916    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.395120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.395068    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.396630 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.396586    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.396732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.396715    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.456995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.456962    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd8b5\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.460315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.460286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\") pod \"e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") " pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:36.754344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:36.754235    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:37.403961 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.350298    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:29:37.475979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.475868    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:37.476305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.476277    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:37.476462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.476443    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:37.508413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.508371    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:29:37.525217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.523922    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.561956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.561925    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:29:37.577594 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.577567    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-01c440ca-openshift-default-dockercfg-tmwvd\""
Oct 30 23:29:37.600126 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600083    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600155    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhm4k\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600179    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600224    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600273    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600312    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600391    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600595 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600458    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.600595 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.600511    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702266    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702327    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702386    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhm4k\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702421    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702484    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702640    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702770    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.702921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702871    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.703142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.702991    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.703444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.703415    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.703609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.703581    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.703747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.703725    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.704084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.704065    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.706195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.706169    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.706387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.706365    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.778073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.778039    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.778708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.778681    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhm4k\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\") pod \"e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") " pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:37.881258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:37.881108    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:38.333886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.333708    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:29:38.337304 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:38.337264    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8aecc7_c967_433f_832c_85c7d94edf01.slice/crio-c4d24caefc76d53fe90efc43ac72b8f6fc79e7de17cc2096897c8badcdea0b7e WatchSource:0}: Error finding container c4d24caefc76d53fe90efc43ac72b8f6fc79e7de17cc2096897c8badcdea0b7e: Status 404 returned error can't find the container with id c4d24caefc76d53fe90efc43ac72b8f6fc79e7de17cc2096897c8badcdea0b7e
Oct 30 23:29:38.340315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.340274    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:38.340415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.340360    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:38.340415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.340403    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:38.477628 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.477588    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerStarted","Data":"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"}
Oct 30 23:29:38.478073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.477669    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerStarted","Data":"de517530682b7dbd0843730443e847ae297a44875b4863647204234ae5490db5"}
Oct 30 23:29:38.479769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.479740    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerStarted","Data":"057787e9c94ed1f0fc1e5f1c66583695173dec7c152560ac5f0922485b6d89cf"}
Oct 30 23:29:38.479917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.479785    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerStarted","Data":"c4d24caefc76d53fe90efc43ac72b8f6fc79e7de17cc2096897c8badcdea0b7e"}
Oct 30 23:29:38.609360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.609234    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podStartSLOduration=2.609214731 podStartE2EDuration="2.609214731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:38.607024338 +0000 UTC m=+1350.367116903" watchObservedRunningTime="2026-10-30 23:29:38.609214731 +0000 UTC m=+1350.369307303"
Oct 30 23:29:38.755244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.755207    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:38.762144 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.762119    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:38.881924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.881821    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:38.884553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:38.884494    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podStartSLOduration=1.884474217 podStartE2EDuration="1.884474217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:38.72907468 +0000 UTC m=+1350.489167252" watchObservedRunningTime="2026-10-30 23:29:38.884474217 +0000 UTC m=+1350.644566789"
Oct 30 23:29:39.488325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:39.488284    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:39.489318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:39.489301    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:29:39.887705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:39.887628    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:40.617563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:40.615384    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:40.617563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:40.617562    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:29:43.974885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:43.974848    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:29:43.979924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:43.979901    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.015558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.015523    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.015768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.015742    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.015874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.015858    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq524\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.015938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.015924    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.016008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.015993    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.016056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.016036    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.016143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.016129    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.016232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.016218    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.016313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.016297    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.089340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.089235    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:29:44.117899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.117863    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.117965    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq524\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118006    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118032    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118068    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118114    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118186    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118264    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.118498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118359    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.119019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.118995    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.119183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.119132    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.119555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.119532    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.119812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.119789    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.120393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.120370    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.123135 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.123089    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.123441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.123417    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.179063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.179031    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.179299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.179216    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq524\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\") pod \"e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") " pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.296431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.296349    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:44.736301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.732989    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:29:44.738913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.738877    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:44.739040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.738958    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:44.739040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:44.739027    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:29:45.620163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:45.620129    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" event={"ID":"4f57cb42-e295-46b0-91fb-de1592cc4ce3","Type":"ContainerStarted","Data":"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"}
Oct 30 23:29:45.620580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:45.620186    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" event={"ID":"4f57cb42-e295-46b0-91fb-de1592cc4ce3","Type":"ContainerStarted","Data":"03f116840e422fbcfdbde7ca769e103ead77d107c93a4b3f5d6c921cf9c539d3"}
Oct 30 23:29:46.299001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:46.298964    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:46.303809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:46.303776    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:46.304053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:46.304025    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:47.158147 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.150436    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podStartSLOduration=4.150417023 podStartE2EDuration="4.150417023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:45.810911994 +0000 UTC m=+1357.571004567" watchObservedRunningTime="2026-10-30 23:29:47.150417023 +0000 UTC m=+1358.910509595"
Oct 30 23:29:47.377677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.373311    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:29:47.396644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.386012    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:47.396644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.386075    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:47.396644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.392841    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.458686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.457793    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:29:47.522729 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.522691    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-49d07c83\""
Oct 30 23:29:47.523821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.523662    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-49d07c83-dockercfg-sgnw9\""
Oct 30 23:29:47.627377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.627087    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg8m8\" (UniqueName: \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.627377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.627209    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.729102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.729057    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg8m8\" (UniqueName: \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.729317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.729185    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.730249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.730224    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:47.821644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:47.820377    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg8m8\" (UniqueName: \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\") pod \"payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") " pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:48.069952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:48.069882    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:48.351696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:48.347882    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:48.351696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:48.347935    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:48.577246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:48.577217    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:29:48.578263 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:29:48.578237    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15b292d_f2e9_4fca_bd65_20eb909010fd.slice/crio-efc8848ed29bf45f962be35ea2d64231cf79eb506d20701c67a5d431de53ba99 WatchSource:0}: Error finding container efc8848ed29bf45f962be35ea2d64231cf79eb506d20701c67a5d431de53ba99: Status 404 returned error can't find the container with id efc8848ed29bf45f962be35ea2d64231cf79eb506d20701c67a5d431de53ba99
Oct 30 23:29:48.722680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:48.722650    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" event={"ID":"c15b292d-f2e9-4fca-bd65-20eb909010fd","Type":"ContainerStarted","Data":"efc8848ed29bf45f962be35ea2d64231cf79eb506d20701c67a5d431de53ba99"}
Oct 30 23:29:49.303401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:49.303363    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:49.303815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:49.303781    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:49.733369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:49.733337    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" event={"ID":"c15b292d-f2e9-4fca-bd65-20eb909010fd","Type":"ContainerStarted","Data":"42ce3853c4bcdf74982f345fbb235e3d60c10d8b0bbcbc510383c2cecf58d6ef"}
Oct 30 23:29:49.733835 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:49.733557    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:29:49.869401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:49.869342    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" podStartSLOduration=2.869321932 podStartE2EDuration="2.869321932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:29:49.867452069 +0000 UTC m=+1361.627544650" watchObservedRunningTime="2026-10-30 23:29:49.869321932 +0000 UTC m=+1361.629414506"
Oct 30 23:29:50.302644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:50.298959    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:50.302644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:50.299020    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:51.296841 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:51.296803    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:51.297263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:51.296883    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:52.301255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:52.300780    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:29:52.301255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:52.300836    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 23:29:53.801643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:53.795000    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:53.991645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:53.987949    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:54.056462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.056359    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:54.159840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.159778    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:54.160150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.160113    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:54.206640 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.204797    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:54.206640 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.204867    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:54.251642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.245785    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:54.278719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.278666    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:54.430700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.405100    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Oct 30 23:29:54.723741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.723594    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:54.724175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.724139    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:55.099703 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.996224    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:55.126060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:54.996286    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded"
Oct 30 23:29:55.140163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.140129    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:29:55.140421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.140404    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:29:55.141581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.117431    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 23:29:55.201644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.177370    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:29:55.468004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.452388    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:55.487865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:55.485145    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:29:56.033646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.007158    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": context deadline exceeded"
Oct 30 23:29:56.071673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.054720    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:56.071673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.054784    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:56.131791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.131667    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:56.217873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.140938    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:56.217873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.155770    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:56.217873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.162217    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:56.217873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.179812    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:56.217873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.181937    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:29:56.532156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:56.530980    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:57.171194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:57.171151    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 23:29:57.219850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:57.172035    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:57.223813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:57.180049    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 23:29:57.582731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:57.582666    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:58.164752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.164703    6126 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:58.312261 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.312224    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 23:29:58.389674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.359237    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 30 23:29:58.561654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.558204    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:58.852078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.824803    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:29:58.852957 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.852898    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:58.938347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:58.938305    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:59.376715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:59.366833    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:59.376715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:59.368090    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:59.595673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:59.593329    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl" podUID="9f67f360-db37-4061-83e9-d95856cd2252" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:59.608859 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:59.608799    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:29:59.941851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:29:59.941801    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:30:00.185546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.179102    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm" podUID="5b9b407f-c259-48fd-b0bd-dfa6af481475" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:30:00.276196 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:30:00.273215    6126 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.842s"
Oct 30 23:30:00.276196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.273383    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:30:00.368706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.368672    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:30:00.432403 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.432359    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9sngd" podUID="08cdd497-eb0a-4992-a697-4645a9730e07" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Oct 30 23:30:00.644151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.644048    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7b98bb678c-f82lh" podUID="50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.45:50052\" within 1s: context deadline exceeded"
Oct 30 23:30:00.677750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:00.664698    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:30:01.270637 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.269571    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:30:01.289979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.289946    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:30:01.289979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.289983    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:30:01.290216 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.290035    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:30:01.290216 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.290073    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:30:01.292282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.292225    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.348667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.348492    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2b6c82a0\""
Oct 30 23:30:01.348667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.348631    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2b6c82a0-dockercfg-tqrw7\""
Oct 30 23:30:01.397999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.397958    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.398243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.398223    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twk5s\" (UniqueName: \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.499663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.499601    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.500147 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.499816    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twk5s\" (UniqueName: \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.501272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.501242    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.572723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.572568    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twk5s\" (UniqueName: \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\") pod \"payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:01.626276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:01.625916    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:02.073507 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:02.073469    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:30:02.085241 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:30:02.083790    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04294252_4e5b_486c_9961_361005d15771.slice/crio-3087ab661cefcd40f9b7372925e7de25ed7e1429881103ea4a245a5321ede808 WatchSource:0}: Error finding container 3087ab661cefcd40f9b7372925e7de25ed7e1429881103ea4a245a5321ede808: Status 404 returned error can't find the container with id 3087ab661cefcd40f9b7372925e7de25ed7e1429881103ea4a245a5321ede808
Oct 30 23:30:02.813515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:02.813468    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" event={"ID":"04294252-4e5b-486c-9961-361005d15771","Type":"ContainerStarted","Data":"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"}
Oct 30 23:30:02.814023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:02.813543    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" event={"ID":"04294252-4e5b-486c-9961-361005d15771","Type":"ContainerStarted","Data":"3087ab661cefcd40f9b7372925e7de25ed7e1429881103ea4a245a5321ede808"}
Oct 30 23:30:02.814023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:02.813573    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:02.931780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:02.931708    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" podStartSLOduration=2.9316884 podStartE2EDuration="2.9316884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:30:02.929756972 +0000 UTC m=+1374.689849543" watchObservedRunningTime="2026-10-30 23:30:02.9316884 +0000 UTC m=+1374.691780972"
Oct 30 23:30:04.152787 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:30:04.152749    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:30:06.217267 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.217226    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:30:06.273630 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.273583    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:30:06.273891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.273749    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.358481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358450    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.358698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358510    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.358698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358598    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.358804 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358766    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5pz\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.358955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358934    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.359024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.358992    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.359103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.359089    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.443591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.443560    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 23:30:06.443591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.443576    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 23:30:06.443948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.443926    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 23:30:06.444003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.443954    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fdjft\""
Oct 30 23:30:06.460957 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.460917    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5pz\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461084    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461142    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461308    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461522 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461496    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461584    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.461716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.461658    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.462054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.462020    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.463867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.463844    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.464063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.464044    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.464331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.464304    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.464433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.464414    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.519847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.519768    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5pz\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.520014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.519861    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-wm962\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:06.594705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:06.594666    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:07.053169 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:07.053140    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:30:07.053762 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:30:07.053735    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fc637b_067e_4f94_a6e9_d3407eb10bc3.slice/crio-106941b6f39a0957000058368caf8f317a919966aef5b0b9f39068521b132415 WatchSource:0}: Error finding container 106941b6f39a0957000058368caf8f317a919966aef5b0b9f39068521b132415: Status 404 returned error can't find the container with id 106941b6f39a0957000058368caf8f317a919966aef5b0b9f39068521b132415
Oct 30 23:30:07.889264 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:07.889227    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" event={"ID":"26fc637b-067e-4f94-a6e9-d3407eb10bc3","Type":"ContainerStarted","Data":"106941b6f39a0957000058368caf8f317a919966aef5b0b9f39068521b132415"}
Oct 30 23:30:10.891956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:10.891514    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:10.891956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:10.891596    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:11.929124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:11.929090    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" event={"ID":"26fc637b-067e-4f94-a6e9-d3407eb10bc3","Type":"ContainerStarted","Data":"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"}
Oct 30 23:30:11.929701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:11.929309    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:11.931155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:11.931131    6126 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-wm962 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:30:11.931300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:11.931177    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:30:12.145168 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.145090    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" podStartSLOduration=3.311025899 podStartE2EDuration="7.145071058s" totalImagesPullingTime="3.834045159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:30:12.140951938 +0000 UTC m=+1383.901044518" watchObservedRunningTime="2026-10-30 23:30:12.145071058 +0000 UTC m=+1383.905163631"
Oct 30 23:30:12.724191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.723575    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:30:12.731815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.731782    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.802778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.802720    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5z9j\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.802973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.802855    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.802973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.802885    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.802973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.802917    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.803102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.802969    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.803138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.803100    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.803193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.803178    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.803252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.803232    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.803473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.803451    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.844990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.844953    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:30:12.905107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905055    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905173    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905195    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905403 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905315    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905403 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905351    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5z9j\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905403 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905385    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905405    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905448    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905479    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905502    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905528    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.905845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905825    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.906001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.905972    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.906203 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.906184    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.907812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.907792    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.908158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.908136    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.937079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.937055    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:30:12.967113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.967079    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:12.967266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:12.967189    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5z9j\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\") pod \"maas-default-gateway-openshift-default-5df48fcc99-2hwf2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:13.049099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.049007    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:13.502740 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.502707    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:30:13.503041 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:30:13.503003    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198506e5_5eb0_4718_be4a_d82ceff4b5f2.slice/crio-61b0ef62466e30aedaf17288c5636f29897c5ba0ae012e7f52d5c20153c9d7b1 WatchSource:0}: Error finding container 61b0ef62466e30aedaf17288c5636f29897c5ba0ae012e7f52d5c20153c9d7b1: Status 404 returned error can't find the container with id 61b0ef62466e30aedaf17288c5636f29897c5ba0ae012e7f52d5c20153c9d7b1
Oct 30 23:30:13.506067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.506034    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:13.506160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.506104    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:13.506160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.506134    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:13.832899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.832789    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:30:13.945465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.945433    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" event={"ID":"198506e5-5eb0-4718-be4a-d82ceff4b5f2","Type":"ContainerStarted","Data":"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"}
Oct 30 23:30:13.945925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:13.945495    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" event={"ID":"198506e5-5eb0-4718-be4a-d82ceff4b5f2","Type":"ContainerStarted","Data":"61b0ef62466e30aedaf17288c5636f29897c5ba0ae012e7f52d5c20153c9d7b1"}
Oct 30 23:30:14.049486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:14.049447    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:14.051276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:14.051254    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:14.051354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:14.051309    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:14.070387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:14.070312    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podStartSLOduration=2.070292414 podStartE2EDuration="2.070292414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:30:14.068071241 +0000 UTC m=+1385.828163805" watchObservedRunningTime="2026-10-30 23:30:14.070292414 +0000 UTC m=+1385.830385059"
Oct 30 23:30:15.049512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:15.049466    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:15.049955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:15.049526    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:16.049511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:16.049476    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:16.049719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:16.049534    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:17.050381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:17.050342    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:17.050838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:17.050399    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:18.049806 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:18.049768    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:18.049985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:18.049826    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:19.050025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:19.049986    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:19.050425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:19.050061    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:20.050309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:20.050233    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:20.050981 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:20.050947    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:21.049816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:21.049779    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:30:21.050029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:21.049842    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 23:30:22.608491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:22.608454    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:22.609666 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:22.609492    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:22.610314 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:22.610293    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:30:30.346275 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.346239    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:30:30.350916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.350892    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.449273 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.449237    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqpk9\" (UniqueName: \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.449518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.449475    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.449679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.449632    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.449828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.449796    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.454979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.454955    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-01c440ca-serving-cert\""
Oct 30 23:30:30.461460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.461435    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:30:30.551384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.551351    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.551570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.551500    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.551689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.551669    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqpk9\" (UniqueName: \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.552033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.552008    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.552168 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:30:30.552143    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-serving-cert: secret "maas-api-e2e-derive-01c440ca-serving-cert" not found
Oct 30 23:30:30.552241 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:30:30.552225    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls podName:7b91fc17-2d10-46f6-b851-6fe70faa42bd nodeName:}" failed. No retries permitted until 2026-10-30 23:30:31.052202453 +0000 UTC m=+1402.812295028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls") pod "maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" (UID: "7b91fc17-2d10-46f6-b851-6fe70faa42bd") : secret "maas-api-e2e-derive-01c440ca-serving-cert" not found
Oct 30 23:30:30.552309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.552273    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.554424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.554399    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:30.613911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:30.613831    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqpk9\" (UniqueName: \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:31.061283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:31.061248    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:31.063857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:31.063829    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") pod \"maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:31.267647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:31.267584    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:31.658147 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:31.658117    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:30:31.659556 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:30:31.659517    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b91fc17_2d10_46f6_b851_6fe70faa42bd.slice/crio-1494ea389269e58f2430a3edeedd2f2c7844e86f94c360eccbe153adaceb1497 WatchSource:0}: Error finding container 1494ea389269e58f2430a3edeedd2f2c7844e86f94c360eccbe153adaceb1497: Status 404 returned error can't find the container with id 1494ea389269e58f2430a3edeedd2f2c7844e86f94c360eccbe153adaceb1497
Oct 30 23:30:32.136374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:32.136330    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" event={"ID":"7b91fc17-2d10-46f6-b851-6fe70faa42bd","Type":"ContainerStarted","Data":"1494ea389269e58f2430a3edeedd2f2c7844e86f94c360eccbe153adaceb1497"}
Oct 30 23:30:33.146366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:33.146331    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" event={"ID":"7b91fc17-2d10-46f6-b851-6fe70faa42bd","Type":"ContainerStarted","Data":"af4437246c839238c45c6446aed04ae69cd9a9db60b8119a3bc3aae003043bdd"}
Oct 30 23:30:33.146812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:33.146395    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:33.264239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:33.264184    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" podStartSLOduration=2.397395558 podStartE2EDuration="3.26417129s" totalImagesPullingTime="866.775732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:30:33.262794523 +0000 UTC m=+1405.022887095" watchObservedRunningTime="2026-10-30 23:30:33.26417129 +0000 UTC m=+1405.024263860"
Oct 30 23:30:34.153963 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:30:34.153924    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:30:39.164684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:39.164601    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:30:48.369810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:48.369767    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:30:48.370351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:48.369828    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:30:49.379742 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.379703    6126 generic.go:356] "Generic (PLEG): container finished" podID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerID="69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4" exitCode=0
Oct 30 23:30:49.380196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.379782    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerDied","Data":"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"}
Oct 30 23:30:49.380305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.380290    6126 scope.go:122] "RemoveContainer" containerID="69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"
Oct 30 23:30:49.382309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.382275    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:49.382383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.382363    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:49.382426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:49.382411    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:30:50.434496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:50.434446    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerStarted","Data":"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"}
Oct 30 23:30:50.694702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:50.689574    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:30:50.694702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:50.689735    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 23:30:50.694702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:50.689812    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 23:30:51.685641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:51.683007    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 23:30:51.685641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:51.683064    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 23:30:52.681644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:52.678938    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 23:30:52.681644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:52.679009    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 23:30:53.688774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:53.687578    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 23:30:53.688774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:53.687678    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 23:30:54.682642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:54.679035    6126 patch_prober.go:29] interesting pod/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Oct 30 23:30:54.682642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:54.679107    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Oct 30 23:30:55.683702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:55.683671    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:30:55.684220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:55.684205    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:30:55.685016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:30:55.684993    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:31:04.165284 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:31:04.165240    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:31:04.490351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.490286    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:31:04.497401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.497377    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.548328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.548293    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:31:04.605537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.604720    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-40c57b52-serving-cert\""
Oct 30 23:31:04.605885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.605849    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.606026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.605913    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.621099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.621053    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqjzf\" (UniqueName: \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.621344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.621165    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.763750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.762223    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqjzf\" (UniqueName: \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.763750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.762405    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.763750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.762775    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.763750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.762823    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.764262 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:31:04.764232    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-serving-cert: secret "maas-api-e2e-ait-40c57b52-serving-cert" not found
Oct 30 23:31:04.764327 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.764262    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.764327 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:31:04.764325    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls podName:a8807aef-4d2f-4300-81a2-25a353f99442 nodeName:}" failed. No retries permitted until 2026-10-30 23:31:05.264305106 +0000 UTC m=+1437.024397667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls") pod "maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" (UID: "a8807aef-4d2f-4300-81a2-25a353f99442") : secret "maas-api-e2e-ait-40c57b52-serving-cert" not found
Oct 30 23:31:04.769745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.769718    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:04.965646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:04.916416    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqjzf\" (UniqueName: \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:05.333230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:05.333190    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:05.339238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:05.339200    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") pod \"maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:05.422127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:05.422011    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:05.872429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:05.872394    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:31:05.873392 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:31:05.873365    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8807aef_4d2f_4300_81a2_25a353f99442.slice/crio-0b0bee4fc972619ae2ae969b0a5baacace09bdf638db15f883965a42c4f71b68 WatchSource:0}: Error finding container 0b0bee4fc972619ae2ae969b0a5baacace09bdf638db15f883965a42c4f71b68: Status 404 returned error can't find the container with id 0b0bee4fc972619ae2ae969b0a5baacace09bdf638db15f883965a42c4f71b68
Oct 30 23:31:06.748376 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:06.748030    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" event={"ID":"a8807aef-4d2f-4300-81a2-25a353f99442","Type":"ContainerStarted","Data":"0b0bee4fc972619ae2ae969b0a5baacace09bdf638db15f883965a42c4f71b68"}
Oct 30 23:31:07.860849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:07.860801    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" event={"ID":"a8807aef-4d2f-4300-81a2-25a353f99442","Type":"ContainerStarted","Data":"8a4bfdae4a44fe534db5e6d384be75cda6bfc67337fa54acc74da221786d35cc"}
Oct 30 23:31:07.861389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:07.860978    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:08.007646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:08.005233    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" podStartSLOduration=3.104195798 podStartE2EDuration="4.005214451s" totalImagesPullingTime="901.018653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:31:08.004258945 +0000 UTC m=+1439.764351524" watchObservedRunningTime="2026-10-30 23:31:08.005214451 +0000 UTC m=+1439.765307028"
Oct 30 23:31:11.657188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:11.656820    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:31:11.657188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:11.656884    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:31:13.874515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:13.874487    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:31:14.926951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.926916    6126 generic.go:356] "Generic (PLEG): container finished" podID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerID="44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698" exitCode=0
Oct 30 23:31:14.927482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.926968    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerDied","Data":"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"}
Oct 30 23:31:14.927575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.927502    6126 scope.go:122] "RemoveContainer" containerID="44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"
Oct 30 23:31:14.929425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.929390    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:14.929530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.929466    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:14.929530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:14.929505    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:15.939392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.939357    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerStarted","Data":"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"}
Oct 30 23:31:15.941164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.941138    6126 generic.go:356] "Generic (PLEG): container finished" podID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerID="057787e9c94ed1f0fc1e5f1c66583695173dec7c152560ac5f0922485b6d89cf" exitCode=0
Oct 30 23:31:15.941318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.941202    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerDied","Data":"057787e9c94ed1f0fc1e5f1c66583695173dec7c152560ac5f0922485b6d89cf"}
Oct 30 23:31:15.941649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.941595    6126 scope.go:122] "RemoveContainer" containerID="057787e9c94ed1f0fc1e5f1c66583695173dec7c152560ac5f0922485b6d89cf"
Oct 30 23:31:15.943252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.943222    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:15.943339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.943309    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:15.943399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:15.943348    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:16.754700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:16.754660    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:31:16.754960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:16.754935    6126 patch_prober.go:29] interesting pod/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:31:16.755055 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:16.754991    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Oct 30 23:31:16.950722 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:16.950686    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerStarted","Data":"3d25e87620b20980814c6ad0d78c7f6ef9e96adcd7b7673bc4e75321026e8e8d"}
Oct 30 23:31:17.754889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:17.754845    6126 patch_prober.go:29] interesting pod/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:31:17.755074 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:17.754917    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Oct 30 23:31:17.886643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:17.883087    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:31:17.886643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:17.883218    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:31:17.886643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:17.883262    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 23:31:18.754793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:18.754760    6126 patch_prober.go:29] interesting pod/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:31:18.755312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:18.754820    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Oct 30 23:31:18.887655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:18.887090    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:31:18.887655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:18.887154    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 23:31:19.758149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:19.758105    6126 patch_prober.go:29] interesting pod/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:31:19.758762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:19.758731    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Oct 30 23:31:19.892808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:19.885162    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:31:19.892808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:19.885226    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 23:31:20.754905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:20.754876    6126 patch_prober.go:29] interesting pod/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:31:20.755172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:20.755149    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Oct 30 23:31:20.883175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:20.883138    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:31:20.884004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:20.883792    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 23:31:21.760355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:21.760323    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:31:21.760843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:21.760828    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:31:21.761667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:21.761606    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:31:21.894817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:21.894778    6126 patch_prober.go:29] interesting pod/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:31:21.898048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:21.898011    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 23:31:22.887868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:22.887831    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:31:22.888320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:22.888305    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:31:22.889291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:22.889267    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:31:34.157477 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:31:34.157435    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:31:42.119246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:42.119205    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:31:47.120439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.120394    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" podUID="c15b292d-f2e9-4fca-bd65-20eb909010fd" containerName="payload-processing" containerID="cri-o://42ce3853c4bcdf74982f345fbb235e3d60c10d8b0bbcbc510383c2cecf58d6ef" gracePeriod=25
Oct 30 23:31:47.287279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.287247    6126 generic.go:356] "Generic (PLEG): container finished" podID="c15b292d-f2e9-4fca-bd65-20eb909010fd" containerID="42ce3853c4bcdf74982f345fbb235e3d60c10d8b0bbcbc510383c2cecf58d6ef" exitCode=0
Oct 30 23:31:47.287462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.287323    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" event={"ID":"c15b292d-f2e9-4fca-bd65-20eb909010fd","Type":"ContainerDied","Data":"42ce3853c4bcdf74982f345fbb235e3d60c10d8b0bbcbc510383c2cecf58d6ef"}
Oct 30 23:31:47.411741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.411717    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:31:47.484256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.484209    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\" (UniqueName: \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\") pod \"c15b292d-f2e9-4fca-bd65-20eb909010fd\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") "
Oct 30 23:31:47.484421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.484367    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\") pod \"c15b292d-f2e9-4fca-bd65-20eb909010fd\" (UID: \"c15b292d-f2e9-4fca-bd65-20eb909010fd\") "
Oct 30 23:31:47.484871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.484840    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume" pod "c15b292d-f2e9-4fca-bd65-20eb909010fd" (UID: "c15b292d-f2e9-4fca-bd65-20eb909010fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:31:47.485433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.485409    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c15b292d-f2e9-4fca-bd65-20eb909010fd-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:31:47.486663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.486640    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8" pod "c15b292d-f2e9-4fca-bd65-20eb909010fd" (UID: "c15b292d-f2e9-4fca-bd65-20eb909010fd"). InnerVolumeSpecName "kube-api-access-wg8m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:31:47.594261 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:47.594219    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg8m8\" (UniqueName: \"kubernetes.io/projected/c15b292d-f2e9-4fca-bd65-20eb909010fd-kube-api-access-wg8m8\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:31:48.297866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:48.297833    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"
Oct 30 23:31:48.298306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:48.297879    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf" event={"ID":"c15b292d-f2e9-4fca-bd65-20eb909010fd","Type":"ContainerDied","Data":"efc8848ed29bf45f962be35ea2d64231cf79eb506d20701c67a5d431de53ba99"}
Oct 30 23:31:48.298306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:48.297942    6126 scope.go:122] "RemoveContainer" containerID="42ce3853c4bcdf74982f345fbb235e3d60c10d8b0bbcbc510383c2cecf58d6ef"
Oct 30 23:31:48.466241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:48.466201    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:31:48.515934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:48.515903    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49d07c83-59c5d4d8ff-lflwf"]
Oct 30 23:31:50.409686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:50.409609    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c15b292d-f2e9-4fca-bd65-20eb909010fd" path="/var/lib/kubelet/pods/c15b292d-f2e9-4fca-bd65-20eb909010fd/volumes"
Oct 30 23:31:58.532959 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.532924    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:31:58.533718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.533703    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c15b292d-f2e9-4fca-bd65-20eb909010fd" containerName="payload-processing"
Oct 30 23:31:58.533718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.533718    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c15b292d-f2e9-4fca-bd65-20eb909010fd" containerName="payload-processing"
Oct 30 23:31:58.533863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.533854    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c15b292d-f2e9-4fca-bd65-20eb909010fd" containerName="payload-processing"
Oct 30 23:31:58.536385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.536367    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551270    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551460    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551572    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxbpp\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551692    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551826    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.551909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.551871    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.552015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.552001    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.552080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.552034    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.552136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.552101    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654222 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654189    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654241    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654300    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654453    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654576 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654537    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.654701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654657    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbpp\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654748    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654662    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.654876    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.655013    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.655071    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.655472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.655225    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.656108 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.656082    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.656394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.656342    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.658454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.658424    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.658591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.658572    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.714404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.714329    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.715333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.715304    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxbpp\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\") pod \"maas-default-gateway-openshift-default-5df48fcc99-v7lwx\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:58.753382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.753350    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:31:58.850395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:58.850296    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:31:59.292457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.292410    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:31:59.328582 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:31:59.328541    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0aa1efe_c2cc_4a3b_8ffe_1e81f7e760f2.slice/crio-2cabf1e936767ad7b1de4d6770fb253c4024b60730b32a4eecafd6e2fb488d98 WatchSource:0}: Error finding container 2cabf1e936767ad7b1de4d6770fb253c4024b60730b32a4eecafd6e2fb488d98: Status 404 returned error can't find the container with id 2cabf1e936767ad7b1de4d6770fb253c4024b60730b32a4eecafd6e2fb488d98
Oct 30 23:31:59.331438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.331398    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:59.331513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.331471    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:59.331513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.331500    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:31:59.515241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.515200    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" event={"ID":"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2","Type":"ContainerStarted","Data":"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"}
Oct 30 23:31:59.515441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.515269    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" event={"ID":"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2","Type":"ContainerStarted","Data":"2cabf1e936767ad7b1de4d6770fb253c4024b60730b32a4eecafd6e2fb488d98"}
Oct 30 23:31:59.636782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.636600    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podStartSLOduration=1.636579578 podStartE2EDuration="1.636579578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:31:59.636563032 +0000 UTC m=+1491.396655633" watchObservedRunningTime="2026-10-30 23:31:59.636579578 +0000 UTC m=+1491.396672150"
Oct 30 23:31:59.850503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:31:59.850469    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:32:00.853385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:00.853345    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:00.853848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:00.853404    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:01.850887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:01.850852    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:01.851070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:01.850933    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:02.239112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:02.238925    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:32:02.850925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:02.850888    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:02.851693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:02.851657    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:03.859644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:03.854377    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:03.859644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:03.854458    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:04.242901 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:04.242861    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:32:04.851422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:04.851390    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:04.851597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:04.851445    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:05.850889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:05.850845    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:05.851430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:05.850907    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:06.851409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:06.851365    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 23:32:06.851875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:06.851434    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 23:32:07.239957 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.239909    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" podUID="04294252-4e5b-486c-9961-361005d15771" containerName="payload-pre-processing" containerID="cri-o://4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde" gracePeriod=25
Oct 30 23:32:07.542354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.542326    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:32:07.643475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.643442    6126 generic.go:356] "Generic (PLEG): container finished" podID="04294252-4e5b-486c-9961-361005d15771" containerID="4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde" exitCode=0
Oct 30 23:32:07.643655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.643506    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"
Oct 30 23:32:07.643655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.643529    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" event={"ID":"04294252-4e5b-486c-9961-361005d15771","Type":"ContainerDied","Data":"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"}
Oct 30 23:32:07.643655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.643587    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5" event={"ID":"04294252-4e5b-486c-9961-361005d15771","Type":"ContainerDied","Data":"3087ab661cefcd40f9b7372925e7de25ed7e1429881103ea4a245a5321ede808"}
Oct 30 23:32:07.643655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.643609    6126 scope.go:122] "RemoveContainer" containerID="4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"
Oct 30 23:32:07.658336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.658311    6126 scope.go:122] "RemoveContainer" containerID="4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"
Oct 30 23:32:07.658921 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:07.658874    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde\": container with ID starting with 4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde not found: ID does not exist" containerID="4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"
Oct 30 23:32:07.658921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.658914    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde"} err="failed to get container status \"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde\": rpc error: code = NotFound desc = could not find container \"4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde\": container with ID starting with 4d62613675d1655e2900bddfe081141ee8b8d98f4c5d2183ae49b77c65099fde not found: ID does not exist"
Oct 30 23:32:07.686984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.686943    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\" (UniqueName: \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\") pod \"04294252-4e5b-486c-9961-361005d15771\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") "
Oct 30 23:32:07.687514 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.687490    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\") pod \"04294252-4e5b-486c-9961-361005d15771\" (UID: \"04294252-4e5b-486c-9961-361005d15771\") "
Oct 30 23:32:07.695665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.688338    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume" pod "04294252-4e5b-486c-9961-361005d15771" (UID: "04294252-4e5b-486c-9961-361005d15771"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:32:07.697510 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.697481    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04294252-4e5b-486c-9961-361005d15771-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:07.726302 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.726268    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s" pod "04294252-4e5b-486c-9961-361005d15771" (UID: "04294252-4e5b-486c-9961-361005d15771"). InnerVolumeSpecName "kube-api-access-twk5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:07.800149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:07.800054    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twk5s\" (UniqueName: \"kubernetes.io/projected/04294252-4e5b-486c-9961-361005d15771-kube-api-access-twk5s\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:08.069688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.069556    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:32:08.120537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.120505    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2b6c82a0-6fb4468bb7-5vhb5"]
Oct 30 23:32:08.344032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.343947    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:32:08.344385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.344347    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:32:08.345143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.345116    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:32:08.410039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.410006    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04294252-4e5b-486c-9961-361005d15771" path="/var/lib/kubelet/pods/04294252-4e5b-486c-9961-361005d15771/volumes"
Oct 30 23:32:08.643696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.643254    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:32:08.650821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:08.650793    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:32:28.160891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:28.160853    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:32:28.161563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:28.161118    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy" containerID="cri-o://50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8" gracePeriod=30
Oct 30 23:32:33.494244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.494217    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:32:33.586139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586107    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586176    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586233    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586297    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586314    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586374    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586419    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:33.586571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586439    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586470    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\") pod \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\" (UID: \"1d6b8111-dc7a-4bc5-be8d-f173845d275d\") "
Oct 30 23:32:33.586876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586696    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:33.586876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586830    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:33.587027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.586925    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:33.587402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587373    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:32:33.587809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587784    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.587908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587815    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.587908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587831    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.587908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587847    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.587908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.587861    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.588801 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.588777    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:33.588903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.588847    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:32:33.589000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.588980    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "kube-api-access-dm2qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:33.589040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.589012    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token" pod "1d6b8111-dc7a-4bc5-be8d-f173845d275d" (UID: "1d6b8111-dc7a-4bc5-be8d-f173845d275d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:33.689340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.689311    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.689340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.689340    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm2qh\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-kube-api-access-dm2qh\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.689541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.689353    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:33.689541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:33.689366    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d6b8111-dc7a-4bc5-be8d-f173845d275d-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:34.033227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.033191    6126 generic.go:356] "Generic (PLEG): container finished" podID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerID="50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8" exitCode=0
Oct 30 23:32:34.033442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.033259    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"
Oct 30 23:32:34.033442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.033279    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerDied","Data":"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"}
Oct 30 23:32:34.033442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.033371    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24" event={"ID":"1d6b8111-dc7a-4bc5-be8d-f173845d275d","Type":"ContainerDied","Data":"362911bf57c1a294ba5719b035ea1098b5621e474a9fc776f4c500fea62a1b9e"}
Oct 30 23:32:34.033442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.033402    6126 scope.go:122] "RemoveContainer" containerID="50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"
Oct 30 23:32:34.046163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.046144    6126 scope.go:122] "RemoveContainer" containerID="69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"
Oct 30 23:32:34.065143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.065108    6126 scope.go:122] "RemoveContainer" containerID="50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"
Oct 30 23:32:34.066868 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:34.065752    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8\": container with ID starting with 50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8 not found: ID does not exist" containerID="50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"
Oct 30 23:32:34.066868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.065805    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8"} err="failed to get container status \"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8\": rpc error: code = NotFound desc = could not find container \"50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8\": container with ID starting with 50aabdd650ed6c1d7b49e9e95d8f07c96e4ed3ee220d1ad6d6f2f7792d2bb5c8 not found: ID does not exist"
Oct 30 23:32:34.066868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.065855    6126 scope.go:122] "RemoveContainer" containerID="69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"
Oct 30 23:32:34.066868 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:34.066214    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4\": container with ID starting with 69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4 not found: ID does not exist" containerID="69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"
Oct 30 23:32:34.066868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.066290    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4"} err="failed to get container status \"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4\": rpc error: code = NotFound desc = could not find container \"69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4\": container with ID starting with 69a3c2be4cf744bfb978023715f30a223f0b5c52031ea40c42a31f1dbbfc1ea4 not found: ID does not exist"
Oct 30 23:32:34.152379 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:34.152342    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:32:34.209668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.204053    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:32:34.253240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.253197    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-49d07c83-openshift-default-6f977565bf-4fz24"]
Oct 30 23:32:34.408470 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:34.408392    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" path="/var/lib/kubelet/pods/1d6b8111-dc7a-4bc5-be8d-f173845d275d/volumes"
Oct 30 23:32:37.655291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:37.655239    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:32:37.657541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:37.657506    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" podUID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" containerName="maas-api" containerID="cri-o://af4437246c839238c45c6446aed04ae69cd9a9db60b8119a3bc3aae003043bdd" gracePeriod=30
Oct 30 23:32:38.115705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.115671    6126 generic.go:356] "Generic (PLEG): container finished" podID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" containerID="af4437246c839238c45c6446aed04ae69cd9a9db60b8119a3bc3aae003043bdd" exitCode=0
Oct 30 23:32:38.115903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.115718    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" event={"ID":"7b91fc17-2d10-46f6-b851-6fe70faa42bd","Type":"ContainerDied","Data":"af4437246c839238c45c6446aed04ae69cd9a9db60b8119a3bc3aae003043bdd"}
Oct 30 23:32:38.303093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.303059    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:32:38.311676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.310854    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\") pod \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") "
Oct 30 23:32:38.311676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.310917    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") pod \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") "
Oct 30 23:32:38.311676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.310995    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\") pod \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") "
Oct 30 23:32:38.311676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.311134    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\" (UniqueName: \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\") pod \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\" (UID: \"7b91fc17-2d10-46f6-b851-6fe70faa42bd\") "
Oct 30 23:32:38.312102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.312022    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca" pod "7b91fc17-2d10-46f6-b851-6fe70faa42bd" (UID: "7b91fc17-2d10-46f6-b851-6fe70faa42bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:32:38.314736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.314694    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9" pod "7b91fc17-2d10-46f6-b851-6fe70faa42bd" (UID: "7b91fc17-2d10-46f6-b851-6fe70faa42bd"). InnerVolumeSpecName "kube-api-access-sqpk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:38.315233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.315206    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls" pod "7b91fc17-2d10-46f6-b851-6fe70faa42bd" (UID: "7b91fc17-2d10-46f6-b851-6fe70faa42bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:32:38.315431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.315413    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs" pod "7b91fc17-2d10-46f6-b851-6fe70faa42bd" (UID: "7b91fc17-2d10-46f6-b851-6fe70faa42bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:32:38.413072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.413037    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqpk9\" (UniqueName: \"kubernetes.io/projected/7b91fc17-2d10-46f6-b851-6fe70faa42bd-kube-api-access-sqpk9\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:38.413072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.413076    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b91fc17-2d10-46f6-b851-6fe70faa42bd-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:38.413348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.413091    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:38.413348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:38.413106    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b91fc17-2d10-46f6-b851-6fe70faa42bd-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:39.125558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:39.125533    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"
Oct 30 23:32:39.126039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:39.125579    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb" event={"ID":"7b91fc17-2d10-46f6-b851-6fe70faa42bd","Type":"ContainerDied","Data":"1494ea389269e58f2430a3edeedd2f2c7844e86f94c360eccbe153adaceb1497"}
Oct 30 23:32:39.126039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:39.125716    6126 scope.go:122] "RemoveContainer" containerID="af4437246c839238c45c6446aed04ae69cd9a9db60b8119a3bc3aae003043bdd"
Oct 30 23:32:39.304518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:39.304485    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:32:39.354163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:39.354128    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-01c440ca-5db5d4b764-cpsqb"]
Oct 30 23:32:40.072027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:40.067695    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:32:40.072027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:40.068489    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy" containerID="cri-o://3d25e87620b20980814c6ad0d78c7f6ef9e96adcd7b7673bc4e75321026e8e8d" gracePeriod=30
Oct 30 23:32:40.416353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:40.416273    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" path="/var/lib/kubelet/pods/7b91fc17-2d10-46f6-b851-6fe70faa42bd/volumes"
Oct 30 23:32:42.851367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:42.851332    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:32:42.851925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:42.851562    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy" containerID="cri-o://a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a" gracePeriod=30
Oct 30 23:32:45.216839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.216809    6126 generic.go:356] "Generic (PLEG): container finished" podID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerID="3d25e87620b20980814c6ad0d78c7f6ef9e96adcd7b7673bc4e75321026e8e8d" exitCode=0
Oct 30 23:32:45.217269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.216882    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerDied","Data":"3d25e87620b20980814c6ad0d78c7f6ef9e96adcd7b7673bc4e75321026e8e8d"}
Oct 30 23:32:45.217269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.216959    6126 scope.go:122] "RemoveContainer" containerID="057787e9c94ed1f0fc1e5f1c66583695173dec7c152560ac5f0922485b6d89cf"
Oct 30 23:32:45.384396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.384367    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:32:45.481824 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.481788    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.481918    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.481964    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482178 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482156    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:32:45.482243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482177    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482256    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:45.482373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482356    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482393    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482393    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:45.482512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482436    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482481    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482546    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\") pod \"ab8aecc7-c967-433f-832c-85c7d94edf01\" (UID: \"ab8aecc7-c967-433f-832c-85c7d94edf01\") "
Oct 30 23:32:45.482736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482694    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:45.482977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.482955    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:45.483798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.483773    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.483798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.483797    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.483997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.483811    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.483997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.483826    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8aecc7-c967-433f-832c-85c7d94edf01-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.483997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.483839    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.485232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.485200    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:32:45.485232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.485208    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:45.485390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.485226    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "kube-api-access-mhm4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:45.486898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.486876    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token" pod "ab8aecc7-c967-433f-832c-85c7d94edf01" (UID: "ab8aecc7-c967-433f-832c-85c7d94edf01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:45.585899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.585860    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.585899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.585899    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.586139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.585915    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8aecc7-c967-433f-832c-85c7d94edf01-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:45.586139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:45.585930    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhm4k\" (UniqueName: \"kubernetes.io/projected/ab8aecc7-c967-433f-832c-85c7d94edf01-kube-api-access-mhm4k\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:46.227671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:46.227603    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"
Oct 30 23:32:46.228110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:46.227601    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6" event={"ID":"ab8aecc7-c967-433f-832c-85c7d94edf01","Type":"ContainerDied","Data":"c4d24caefc76d53fe90efc43ac72b8f6fc79e7de17cc2096897c8badcdea0b7e"}
Oct 30 23:32:46.228110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:46.227773    6126 scope.go:122] "RemoveContainer" containerID="3d25e87620b20980814c6ad0d78c7f6ef9e96adcd7b7673bc4e75321026e8e8d"
Oct 30 23:32:46.445988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:46.445954    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:32:46.449347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:46.449321    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-01c440ca-openshift-default-747d8fcddf-r8zz6"]
Oct 30 23:32:48.080611 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.080581    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:32:48.239624 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239594    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.239807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239704    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.239807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239771    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.239807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239797    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.239990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239862    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.239990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.239923    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.240136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240012    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:48.240136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240045    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.240136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240067    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:32:48.240277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240215    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:48.240277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240263    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.240377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240351    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\") pod \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\" (UID: \"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9\") "
Oct 30 23:32:48.240904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.240810    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:48.241106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241004    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:48.241585 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241537    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.241585 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241571    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.241585 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241586    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.241901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241601    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.241901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.241634    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.242404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.242379    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:32:48.242941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.242917    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:32:48.243074 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.243053    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:48.244021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.244000    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5" pod "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" (UID: "d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9"). InnerVolumeSpecName "kube-api-access-qd8b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:32:48.250781 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.250736    6126 generic.go:356] "Generic (PLEG): container finished" podID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerID="a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a" exitCode=0
Oct 30 23:32:48.250983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.250794    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"
Oct 30 23:32:48.250983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.250837    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerDied","Data":"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"}
Oct 30 23:32:48.250983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.250915    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p" event={"ID":"d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9","Type":"ContainerDied","Data":"de517530682b7dbd0843730443e847ae297a44875b4863647204234ae5490db5"}
Oct 30 23:32:48.250983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.250947    6126 scope.go:122] "RemoveContainer" containerID="a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"
Oct 30 23:32:48.286725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.286448    6126 scope.go:122] "RemoveContainer" containerID="44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"
Oct 30 23:32:48.304214 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.304180    6126 scope.go:122] "RemoveContainer" containerID="a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"
Oct 30 23:32:48.305039 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:48.304899    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a\": container with ID starting with a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a not found: ID does not exist" containerID="a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"
Oct 30 23:32:48.305039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.304940    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a"} err="failed to get container status \"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a\": rpc error: code = NotFound desc = could not find container \"a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a\": container with ID starting with a4a34b5f6e711430682240d1ebb5cd6396aaea287641f4bcd013e490dc6e951a not found: ID does not exist"
Oct 30 23:32:48.305039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.304967    6126 scope.go:122] "RemoveContainer" containerID="44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"
Oct 30 23:32:48.305300 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:32:48.305274    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698\": container with ID starting with 44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698 not found: ID does not exist" containerID="44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"
Oct 30 23:32:48.305366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.305305    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698"} err="failed to get container status \"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698\": rpc error: code = NotFound desc = could not find container \"44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698\": container with ID starting with 44c258fe4796b155d23b0df79838c2ff03b262ca9d325ed3a353d3105e9b3698 not found: ID does not exist"
Oct 30 23:32:48.343731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.343697    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd8b5\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-kube-api-access-qd8b5\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.343731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.343731    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.343933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.343742    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.343933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.343750    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:32:48.413223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.413184    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" path="/var/lib/kubelet/pods/ab8aecc7-c967-433f-832c-85c7d94edf01/volumes"
Oct 30 23:32:48.424174 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.424144    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:32:48.427982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:48.427959    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2b6c82a0-openshift-default-568fcddd69-btk9p"]
Oct 30 23:32:50.410427 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:50.410386    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" path="/var/lib/kubelet/pods/d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9/volumes"
Oct 30 23:32:51.239638 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.237299    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243646    6126 cpu_manager.go:414] "containerMap: removing container" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243675    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243718    6126 cpu_manager.go:414] "containerMap: removing container" podUID="04294252-4e5b-486c-9961-361005d15771" containerName="payload-pre-processing"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243727    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04294252-4e5b-486c-9961-361005d15771" containerName="payload-pre-processing"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243746    6126 cpu_manager.go:414] "containerMap: removing container" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243754    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243765    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243772    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243825    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243832    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243844    6126 cpu_manager.go:414] "containerMap: removing container" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243851    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243869    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" containerName="maas-api"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.243876    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" containerName="maas-api"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244054    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="04294252-4e5b-486c-9961-361005d15771" containerName="payload-pre-processing"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244069    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244079    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244096    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244106    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6977f7a-c6aa-4ea2-b9b3-5d9832d461a9" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244114    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d6b8111-dc7a-4bc5-be8d-f173845d275d" containerName="istio-proxy"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244126    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b91fc17-2d10-46f6-b851-6fe70faa42bd" containerName="maas-api"
Oct 30 23:32:51.244994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.244139    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:32:51.273708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.272067    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:32:51.273708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.272176    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.315381 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.315356    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2gf\" (UniqueName: \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.315668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.315651    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.332848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.332730    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-196ff7\""
Oct 30 23:32:51.382882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.382853    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-196ff7-dockercfg-nzzdg\""
Oct 30 23:32:51.426641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.424107    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2gf\" (UniqueName: \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.429271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.429234    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.431596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.431532    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.501363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.501291    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2gf\" (UniqueName: \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\") pod \"payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:51.621643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:51.617901    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:32:52.012474 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:52.012446    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:32:52.013544 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:32:52.013514    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b904c3d_5de5_454d_9b4a_08ffe192048b.slice/crio-3a4ee93c907e31a67dcfd82671e6040c9f7ac08723a9dca6318175d2ae34c0d0 WatchSource:0}: Error finding container 3a4ee93c907e31a67dcfd82671e6040c9f7ac08723a9dca6318175d2ae34c0d0: Status 404 returned error can't find the container with id 3a4ee93c907e31a67dcfd82671e6040c9f7ac08723a9dca6318175d2ae34c0d0
Oct 30 23:32:52.301670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:52.301563    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" event={"ID":"5b904c3d-5de5-454d-9b4a-08ffe192048b","Type":"ContainerStarted","Data":"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"}
Oct 30 23:32:52.301670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:52.301653    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" event={"ID":"5b904c3d-5de5-454d-9b4a-08ffe192048b","Type":"ContainerStarted","Data":"3a4ee93c907e31a67dcfd82671e6040c9f7ac08723a9dca6318175d2ae34c0d0"}
Oct 30 23:32:52.301908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:32:52.301690    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:33:03.312902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:03.312861    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:33:03.446495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:03.446424    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" podStartSLOduration=12.446407394 podStartE2EDuration="12.446407394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:32:52.428167142 +0000 UTC m=+1544.188259714" watchObservedRunningTime="2026-10-30 23:33:03.446407394 +0000 UTC m=+1555.206499964"
Oct 30 23:33:04.155982 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:04.155944    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:33:06.176210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.176177    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:33:06.176887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.176394    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" podUID="a8807aef-4d2f-4300-81a2-25a353f99442" containerName="maas-api" containerID="cri-o://8a4bfdae4a44fe534db5e6d384be75cda6bfc67337fa54acc74da221786d35cc" gracePeriod=30
Oct 30 23:33:06.486971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.486934    6126 generic.go:356] "Generic (PLEG): container finished" podID="a8807aef-4d2f-4300-81a2-25a353f99442" containerID="8a4bfdae4a44fe534db5e6d384be75cda6bfc67337fa54acc74da221786d35cc" exitCode=0
Oct 30 23:33:06.487147 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.487064    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" event={"ID":"a8807aef-4d2f-4300-81a2-25a353f99442","Type":"ContainerDied","Data":"8a4bfdae4a44fe534db5e6d384be75cda6bfc67337fa54acc74da221786d35cc"}
Oct 30 23:33:06.536654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.536375    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:33:06.550696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.550664    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\") pod \"a8807aef-4d2f-4300-81a2-25a353f99442\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") "
Oct 30 23:33:06.550871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.550730    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") pod \"a8807aef-4d2f-4300-81a2-25a353f99442\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") "
Oct 30 23:33:06.550871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.550810    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\") pod \"a8807aef-4d2f-4300-81a2-25a353f99442\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") "
Oct 30 23:33:06.550998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.550953    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\" (UniqueName: \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\") pod \"a8807aef-4d2f-4300-81a2-25a353f99442\" (UID: \"a8807aef-4d2f-4300-81a2-25a353f99442\") "
Oct 30 23:33:06.551059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.551017    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca" pod "a8807aef-4d2f-4300-81a2-25a353f99442" (UID: "a8807aef-4d2f-4300-81a2-25a353f99442"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:33:06.551574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.551549    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8807aef-4d2f-4300-81a2-25a353f99442-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:33:06.559497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.559469    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs" pod "a8807aef-4d2f-4300-81a2-25a353f99442" (UID: "a8807aef-4d2f-4300-81a2-25a353f99442"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:33:06.559669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.559474    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf" pod "a8807aef-4d2f-4300-81a2-25a353f99442" (UID: "a8807aef-4d2f-4300-81a2-25a353f99442"). InnerVolumeSpecName "kube-api-access-jqjzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:33:06.559669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.559492    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls" pod "a8807aef-4d2f-4300-81a2-25a353f99442" (UID: "a8807aef-4d2f-4300-81a2-25a353f99442"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:33:06.653659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.653591    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqjzf\" (UniqueName: \"kubernetes.io/projected/a8807aef-4d2f-4300-81a2-25a353f99442-kube-api-access-jqjzf\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:33:06.653864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.653746    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:33:06.653864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:06.653768    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8807aef-4d2f-4300-81a2-25a353f99442-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:33:07.496805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:07.496762    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm" event={"ID":"a8807aef-4d2f-4300-81a2-25a353f99442","Type":"ContainerDied","Data":"0b0bee4fc972619ae2ae969b0a5baacace09bdf638db15f883965a42c4f71b68"}
Oct 30 23:33:07.497303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:07.496825    6126 scope.go:122] "RemoveContainer" containerID="8a4bfdae4a44fe534db5e6d384be75cda6bfc67337fa54acc74da221786d35cc"
Oct 30 23:33:07.497303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:07.496770    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"
Oct 30 23:33:07.664686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:07.664655    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:33:07.717426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:07.717385    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40c57b52-68f588bb7f-2rsnm"]
Oct 30 23:33:08.409123 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:08.409093    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8807aef-4d2f-4300-81a2-25a353f99442" path="/var/lib/kubelet/pods/a8807aef-4d2f-4300-81a2-25a353f99442/volumes"
Oct 30 23:33:27.988851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.988814    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:33:27.989584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.989568    6126 cpu_manager.go:414] "containerMap: removing container" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:33:27.989649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.989586    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab8aecc7-c967-433f-832c-85c7d94edf01" containerName="istio-proxy"
Oct 30 23:33:27.989649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.989627    6126 cpu_manager.go:414] "containerMap: removing container" podUID="a8807aef-4d2f-4300-81a2-25a353f99442" containerName="maas-api"
Oct 30 23:33:27.989649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.989633    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8807aef-4d2f-4300-81a2-25a353f99442" containerName="maas-api"
Oct 30 23:33:27.989762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.989751    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8807aef-4d2f-4300-81a2-25a353f99442" containerName="maas-api"
Oct 30 23:33:27.993332 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:27.993305    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.072089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.072057    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.072470 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.072443    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tnnd\" (UniqueName: \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.072580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.072563    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.072692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.072672    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.103921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.103892    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:33:28.149996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.149970    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-20f33adb-serving-cert\""
Oct 30 23:33:28.174260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.174226    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tnnd\" (UniqueName: \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.174450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.174313    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.174450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.174383    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.174450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.174427    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.174666 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:28.174533    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-serving-cert: secret "maas-api-e2e-migrate-20f33adb-serving-cert" not found
Oct 30 23:33:28.174738 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:28.174727    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls podName:da2c770f-cc70-4ab0-a2c2-95b0040a4d49 nodeName:}" failed. No retries permitted until 2026-10-30 23:33:28.674580276 +0000 UTC m=+1580.434672827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls") pod "maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" (UID: "da2c770f-cc70-4ab0-a2c2-95b0040a4d49") : secret "maas-api-e2e-migrate-20f33adb-serving-cert" not found
Oct 30 23:33:28.175713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.175686    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.189356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.189330    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.235401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.235365    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tnnd\" (UniqueName: \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.686370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.686337    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.689098 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.689073    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") pod \"maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:28.911200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:28.911165    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:29.299250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:29.299212    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:33:29.300306 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:33:29.300280    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2c770f_cc70_4ab0_a2c2_95b0040a4d49.slice/crio-7bee6e1bb0ca9bf376a940a40e8558af0472d32018881d3aaf2d41974e51a744 WatchSource:0}: Error finding container 7bee6e1bb0ca9bf376a940a40e8558af0472d32018881d3aaf2d41974e51a744: Status 404 returned error can't find the container with id 7bee6e1bb0ca9bf376a940a40e8558af0472d32018881d3aaf2d41974e51a744
Oct 30 23:33:29.751210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:29.751177    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" event={"ID":"da2c770f-cc70-4ab0-a2c2-95b0040a4d49","Type":"ContainerStarted","Data":"7bee6e1bb0ca9bf376a940a40e8558af0472d32018881d3aaf2d41974e51a744"}
Oct 30 23:33:30.762537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:30.762496    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" event={"ID":"da2c770f-cc70-4ab0-a2c2-95b0040a4d49","Type":"ContainerStarted","Data":"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"}
Oct 30 23:33:30.763049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:30.762587    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:30.882476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:30.882425    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" podStartSLOduration=3.033864773 podStartE2EDuration="3.88241022s" totalImagesPullingTime="848.545447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:33:30.879511323 +0000 UTC m=+1582.639603897" watchObservedRunningTime="2026-10-30 23:33:30.88241022 +0000 UTC m=+1582.642502791"
Oct 30 23:33:34.152181 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:34.152142    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:33:36.779752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:36.779725    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:33:38.228690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.228657    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:33:38.234004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.233980    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.277936 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.277907    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbfr\" (UniqueName: \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.278096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.278079    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.278152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.278135    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.278298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.278286    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.288739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.287918    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-196ff7-serving-cert\""
Oct 30 23:33:38.291266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.291241    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:33:38.380257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.380189    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbfr\" (UniqueName: \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.381158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.380575    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.381158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.380667    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.381158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.380869    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.381158 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:38.381099    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-serving-cert: secret "maas-api-e2e-shared-a-w4-196ff7-serving-cert" not found
Oct 30 23:33:38.381442 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:33:38.381174    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls podName:985470e4-b1a8-4777-b701-52fe09a7c423 nodeName:}" failed. No retries permitted until 2026-10-30 23:33:38.881152467 +0000 UTC m=+1590.641245028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls") pod "maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" (UID: "985470e4-b1a8-4777-b701-52fe09a7c423") : secret "maas-api-e2e-shared-a-w4-196ff7-serving-cert" not found
Oct 30 23:33:38.382452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.382417    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.384413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.384328    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.439729 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.439700    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbfr\" (UniqueName: \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.893122 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.893087    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:38.895759 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:38.895733    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:39.149645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:39.149532    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:39.543782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:39.543749    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:33:39.544195 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:33:39.544123    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985470e4_b1a8_4777_b701_52fe09a7c423.slice/crio-4d5c583d2346f1701e71fad4a8b415c5e4a629b4ffd45b3a6327a3adfbe45bc1 WatchSource:0}: Error finding container 4d5c583d2346f1701e71fad4a8b415c5e4a629b4ffd45b3a6327a3adfbe45bc1: Status 404 returned error can't find the container with id 4d5c583d2346f1701e71fad4a8b415c5e4a629b4ffd45b3a6327a3adfbe45bc1
Oct 30 23:33:39.839909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:39.839820    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" event={"ID":"985470e4-b1a8-4777-b701-52fe09a7c423","Type":"ContainerStarted","Data":"4d5c583d2346f1701e71fad4a8b415c5e4a629b4ffd45b3a6327a3adfbe45bc1"}
Oct 30 23:33:40.849164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:40.849122    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" event={"ID":"985470e4-b1a8-4777-b701-52fe09a7c423","Type":"ContainerStarted","Data":"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"}
Oct 30 23:33:40.849571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:40.849259    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:33:40.969920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:40.969870    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" podStartSLOduration=2.149547715 podStartE2EDuration="2.969855377s" totalImagesPullingTime="820.307662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:33:40.966542038 +0000 UTC m=+1592.726634702" watchObservedRunningTime="2026-10-30 23:33:40.969855377 +0000 UTC m=+1592.729947947"
Oct 30 23:33:46.862171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:33:46.862138    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:34:01.203485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.203447    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:34:01.203920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.203754    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" containerID="cri-o://5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb" gracePeriod=30
Oct 30 23:34:01.253926 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.253879    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:34:01.254157 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.254113    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy" containerID="cri-o://e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d" gracePeriod=30
Oct 30 23:34:01.259192 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.259166    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:34:01.259429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.259386    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" containerID="cri-o://c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5" gracePeriod=30
Oct 30 23:34:01.304312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.303233    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:34:01.304312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:01.303476    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" containerID="cri-o://78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326" gracePeriod=30
Oct 30 23:34:03.315193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:03.315160    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:34:03.315731 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:03.315221    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:34:04.152846 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:04.152811    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:34:05.186467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:05.186431    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:34:05.186918 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:05.186506    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:34:06.177648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.176412    6126 patch_prober.go:29] interesting pod/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:34:06.177648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.176504    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:34:06.579094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.579069    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:34:06.581053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.581031    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:34:06.629344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.629319    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:34:06.728977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.728944    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.729161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.728990    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.729161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729027    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729052    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.729161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729080    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729110    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729200    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729244    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729259    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729321    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729346    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729381    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729414    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729446    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729490    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729494    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:34:06.729515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729520    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729575    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729611    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729706    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729742    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729793    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729843    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729871    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729915    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730024    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.730119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730098    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\") pod \"a0d2d462-2781-4c96-b046-7150dbdea062\" (UID: \"a0d2d462-2781-4c96-b046-7150dbdea062\") "
Oct 30 23:34:06.730601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730229    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730281    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\") pod \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\" (UID: \"7bd1d6ca-fc3f-4c78-8450-d831d3d51611\") "
Oct 30 23:34:06.730601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730311    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\") pod \"20398bc7-e393-4173-9613-36522c9d27ee\" (UID: \"20398bc7-e393-4173-9613-36522c9d27ee\") "
Oct 30 23:34:06.730983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729516    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731178    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731336    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.731370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731359    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731374    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731389    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729694    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.729989    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730341    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730581    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730785    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731425    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.731497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.730956    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.732041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731649    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.732041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731781    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:34:06.732041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.731971    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:34:06.732395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.732337    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.732517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.732132    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.732517 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.732468    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.733204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.733163    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.734258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734230    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:34:06.734394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734367    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "kube-api-access-wbwn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.734504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734456    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:34:06.734680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734658    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy" pod "20398bc7-e393-4173-9613-36522c9d27ee" (UID: "20398bc7-e393-4173-9613-36522c9d27ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.734894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734876    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:06.734894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.734885    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "kube-api-access-lmg46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.735097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.735082    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token" pod "7bd1d6ca-fc3f-4c78-8450-d831d3d51611" (UID: "7bd1d6ca-fc3f-4c78-8450-d831d3d51611"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.735786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.735767    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l" pod "a0d2d462-2781-4c96-b046-7150dbdea062" (UID: "a0d2d462-2781-4c96-b046-7150dbdea062"). InnerVolumeSpecName "kube-api-access-bkg5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:06.833229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833200    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833231    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833245    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20398bc7-e393-4173-9613-36522c9d27ee-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833259    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmg46\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-kube-api-access-lmg46\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833273    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833286    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833298    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833312    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833326    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833338    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbwn6\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-kube-api-access-wbwn6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833353    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d2d462-2781-4c96-b046-7150dbdea062-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833365    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833377    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d2d462-2781-4c96-b046-7150dbdea062-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833389    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20398bc7-e393-4173-9613-36522c9d27ee-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833403    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkg5l\" (UniqueName: \"kubernetes.io/projected/a0d2d462-2781-4c96-b046-7150dbdea062-kube-api-access-bkg5l\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833416    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833430    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833442    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833454    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bd1d6ca-fc3f-4c78-8450-d831d3d51611-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833467    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20398bc7-e393-4173-9613-36522c9d27ee-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833480    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833494    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d2d462-2781-4c96-b046-7150dbdea062-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:06.833603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:06.833507    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20398bc7-e393-4173-9613-36522c9d27ee-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.019285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.019259    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:34:07.068150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.068111    6126 generic.go:356] "Generic (PLEG): container finished" podID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerID="78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326" exitCode=0
Oct 30 23:34:07.068343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.068162    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"
Oct 30 23:34:07.068343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.068169    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" event={"ID":"b40e3195-a8ae-42eb-9898-ac80a12816a9","Type":"ContainerDied","Data":"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"}
Oct 30 23:34:07.068343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.068240    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg" event={"ID":"b40e3195-a8ae-42eb-9898-ac80a12816a9","Type":"ContainerDied","Data":"84e2ceadd744e6479ea857ad3e825846756825905be7f137f1c98a38564fe794"}
Oct 30 23:34:07.068343 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.068273    6126 scope.go:122] "RemoveContainer" containerID="78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"
Oct 30 23:34:07.069964 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.069942    6126 generic.go:356] "Generic (PLEG): container finished" podID="20398bc7-e393-4173-9613-36522c9d27ee" containerID="5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb" exitCode=0
Oct 30 23:34:07.070074 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.070039    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"
Oct 30 23:34:07.070074 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.070063    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" event={"ID":"20398bc7-e393-4173-9613-36522c9d27ee","Type":"ContainerDied","Data":"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"}
Oct 30 23:34:07.070159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.070106    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2" event={"ID":"20398bc7-e393-4173-9613-36522c9d27ee","Type":"ContainerDied","Data":"6996e51b8151f5fff81a6cf4e1f635f138f2c313e6819529a712fa828e9a9ae3"}
Oct 30 23:34:07.071450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.071431    6126 generic.go:356] "Generic (PLEG): container finished" podID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerID="c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5" exitCode=0
Oct 30 23:34:07.071521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.071508    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" event={"ID":"7bd1d6ca-fc3f-4c78-8450-d831d3d51611","Type":"ContainerDied","Data":"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"}
Oct 30 23:34:07.071570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.071541    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p" event={"ID":"7bd1d6ca-fc3f-4c78-8450-d831d3d51611","Type":"ContainerDied","Data":"5aab953d07cade0e88e33d328ecdd18a16fc99a728f8a1ac829f12877c3e0500"}
Oct 30 23:34:07.071603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.071585    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"
Oct 30 23:34:07.076146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.076125    6126 generic.go:356] "Generic (PLEG): container finished" podID="a0d2d462-2781-4c96-b046-7150dbdea062" containerID="e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d" exitCode=0
Oct 30 23:34:07.076263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.076193    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" event={"ID":"a0d2d462-2781-4c96-b046-7150dbdea062","Type":"ContainerDied","Data":"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"}
Oct 30 23:34:07.076324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.076261    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"
Oct 30 23:34:07.076386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.076265    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz" event={"ID":"a0d2d462-2781-4c96-b046-7150dbdea062","Type":"ContainerDied","Data":"00c6d3c89e37afabd9d73b2cf4e8f9eb14a3f40d5cae1b7d51b7726c571aff4e"}
Oct 30 23:34:07.082101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.082079    6126 scope.go:122] "RemoveContainer" containerID="78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"
Oct 30 23:34:07.082420 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:07.082400    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326\": container with ID starting with 78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326 not found: ID does not exist" containerID="78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"
Oct 30 23:34:07.082510 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.082431    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326"} err="failed to get container status \"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326\": rpc error: code = NotFound desc = could not find container \"78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326\": container with ID starting with 78466ee3ff527f89b5114aca6e988b8f6dbe520ba64a71702e40f5f8f8803326 not found: ID does not exist"
Oct 30 23:34:07.082510 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.082453    6126 scope.go:122] "RemoveContainer" containerID="5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"
Oct 30 23:34:07.092861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.092842    6126 scope.go:122] "RemoveContainer" containerID="5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"
Oct 30 23:34:07.093156 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:07.093132    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb\": container with ID starting with 5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb not found: ID does not exist" containerID="5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"
Oct 30 23:34:07.093211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.093165    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb"} err="failed to get container status \"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb\": rpc error: code = NotFound desc = could not find container \"5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb\": container with ID starting with 5f8e9100d22cd4d0975381bdc7393adbadd7021c6b35e1e2746c4a9ae36bbbeb not found: ID does not exist"
Oct 30 23:34:07.093211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.093182    6126 scope.go:122] "RemoveContainer" containerID="c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"
Oct 30 23:34:07.111005 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.110063    6126 scope.go:122] "RemoveContainer" containerID="c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"
Oct 30 23:34:07.111358 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:07.111065    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5\": container with ID starting with c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5 not found: ID does not exist" containerID="c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"
Oct 30 23:34:07.111358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.111334    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5"} err="failed to get container status \"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5\": rpc error: code = NotFound desc = could not find container \"c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5\": container with ID starting with c8afddcafd8e7c164bf96403685a845e0e17fa2bf20dd6d289b09f86a280fcc5 not found: ID does not exist"
Oct 30 23:34:07.111525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.111474    6126 scope.go:122] "RemoveContainer" containerID="e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"
Oct 30 23:34:07.123526 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.123506    6126 scope.go:122] "RemoveContainer" containerID="e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"
Oct 30 23:34:07.123836 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:07.123818    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d\": container with ID starting with e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d not found: ID does not exist" containerID="e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"
Oct 30 23:34:07.123922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.123844    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d"} err="failed to get container status \"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d\": rpc error: code = NotFound desc = could not find container \"e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d\": container with ID starting with e1e559c851033fa6de85f80cdabd901b98cc755bbfe1df72256c212c70e4b80d not found: ID does not exist"
Oct 30 23:34:07.137680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.137656    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.137795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.137752    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.137874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.137855    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.137889    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:07.138024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138013    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138050    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138089    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138199    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138272    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138302    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:07.138354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138307    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\") pod \"b40e3195-a8ae-42eb-9898-ac80a12816a9\" (UID: \"b40e3195-a8ae-42eb-9898-ac80a12816a9\") "
Oct 30 23:34:07.138493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138472    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:07.138545 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138407    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:34:07.138750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.138732    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:07.139379 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.139358    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.139531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.139514    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.139829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.139790    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e3195-a8ae-42eb-9898-ac80a12816a9-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.143763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.142712    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.143763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.142744    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.143763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.141308    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "kube-api-access-mdp5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:07.143763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.141353    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:07.143763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.142939    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:34:07.149537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.148748    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy" pod "b40e3195-a8ae-42eb-9898-ac80a12816a9" (UID: "b40e3195-a8ae-42eb-9898-ac80a12816a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:34:07.244011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.243980    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.244011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.244005    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.244011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.244016    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdp5v\" (UniqueName: \"kubernetes.io/projected/b40e3195-a8ae-42eb-9898-ac80a12816a9-kube-api-access-mdp5v\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.244246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.244026    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e3195-a8ae-42eb-9898-ac80a12816a9-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:34:07.266244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.266160    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:34:07.269533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.269504    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-l8n7p"]
Oct 30 23:34:07.381324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.381291    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:34:07.384584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.384562    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-c44qz"]
Oct 30 23:34:07.499127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.499095    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:34:07.506089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.506063    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-fmvh2"]
Oct 30 23:34:07.676726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.676643    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:34:07.682983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:07.682951    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-aadaa6-openshift-default-87c69499c-rcmdg"]
Oct 30 23:34:08.408056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:08.408022    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20398bc7-e393-4173-9613-36522c9d27ee" path="/var/lib/kubelet/pods/20398bc7-e393-4173-9613-36522c9d27ee/volumes"
Oct 30 23:34:08.408548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:08.408534    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" path="/var/lib/kubelet/pods/7bd1d6ca-fc3f-4c78-8450-d831d3d51611/volumes"
Oct 30 23:34:08.409035 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:08.409021    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" path="/var/lib/kubelet/pods/a0d2d462-2781-4c96-b046-7150dbdea062/volumes"
Oct 30 23:34:08.409816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:08.409800    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" path="/var/lib/kubelet/pods/b40e3195-a8ae-42eb-9898-ac80a12816a9/volumes"
Oct 30 23:34:18.735482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.735388    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:34:18.736124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736108    6126 cpu_manager.go:414] "containerMap: removing container" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy"
Oct 30 23:34:18.736124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736124    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736141    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736146    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736160    6126 cpu_manager.go:414] "containerMap: removing container" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736165    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736199    6126 cpu_manager.go:414] "containerMap: removing container" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy"
Oct 30 23:34:18.736260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736203    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy"
Oct 30 23:34:18.736582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736301    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bd1d6ca-fc3f-4c78-8450-d831d3d51611" containerName="istio-proxy"
Oct 30 23:34:18.736582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736311    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="20398bc7-e393-4173-9613-36522c9d27ee" containerName="istio-proxy"
Oct 30 23:34:18.736582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736325    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="b40e3195-a8ae-42eb-9898-ac80a12816a9" containerName="istio-proxy"
Oct 30 23:34:18.736582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.736335    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0d2d462-2781-4c96-b046-7150dbdea062" containerName="istio-proxy"
Oct 30 23:34:18.742042 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.742023    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.794679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.794649    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-55666687-serving-cert\""
Oct 30 23:34:18.826549 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.826519    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.826775 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.826582    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.826829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.826797    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqhcn\" (UniqueName: \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.826878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.826825    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.849202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.849168    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:34:18.928298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.928263    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.928514 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.928352    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.928514 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:18.928429    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-55666687-serving-cert: secret "maas-api-e2e-mt-55666687-serving-cert" not found
Oct 30 23:34:18.928514 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:18.928511    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls podName:1bb2a5ff-1708-4d84-8357-4d5c57c4e72a nodeName:}" failed. No retries permitted until 2026-10-30 23:34:19.428491247 +0000 UTC m=+1631.188583799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls") pod "maas-api-e2e-mt-55666687-7659595c45-nhvqv" (UID: "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a") : secret "maas-api-e2e-mt-55666687-serving-cert" not found
Oct 30 23:34:18.928754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.928576    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqhcn\" (UniqueName: \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.928754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.928610    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.929111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.929087    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.931423 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.931400    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:18.992085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:18.992008    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqhcn\" (UniqueName: \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:19.436711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:19.436605    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:19.439305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:19.439278    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") pod \"maas-api-e2e-mt-55666687-7659595c45-nhvqv\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:19.656910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:19.656879    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:20.050369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:20.050328    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:34:20.052190 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:20.052163    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb2a5ff_1708_4d84_8357_4d5c57c4e72a.slice/crio-e94675fa37aed092c906c38bfa2a802484460ecc7e3b7b41a7023706b613ccd1 WatchSource:0}: Error finding container e94675fa37aed092c906c38bfa2a802484460ecc7e3b7b41a7023706b613ccd1: Status 404 returned error can't find the container with id e94675fa37aed092c906c38bfa2a802484460ecc7e3b7b41a7023706b613ccd1
Oct 30 23:34:20.053692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:20.053674    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:34:20.188676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:20.188644    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" event={"ID":"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a","Type":"ContainerStarted","Data":"e94675fa37aed092c906c38bfa2a802484460ecc7e3b7b41a7023706b613ccd1"}
Oct 30 23:34:21.199063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:21.198969    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" event={"ID":"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a","Type":"ContainerStarted","Data":"c3627ece7baa8137bb43b3f7b7ec162d9854cd09b44b4109a9d1c26aa64ce1a4"}
Oct 30 23:34:21.199511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:21.199082    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:21.318736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:21.318688    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" podStartSLOduration=2.510743273 podStartE2EDuration="3.318674281s" totalImagesPullingTime="807.931008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:21.317213255 +0000 UTC m=+1633.077305821" watchObservedRunningTime="2026-10-30 23:34:21.318674281 +0000 UTC m=+1633.078766849"
Oct 30 23:34:27.215670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:27.215639    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:34:34.153492 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:34:34.153456    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:34:34.876050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.876018    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:34:34.883374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.883336    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:34.926902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.926829    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:34.927863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.927835    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-622kh\" (UniqueName: \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:34.939839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.939806    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w6-fb14dc\""
Oct 30 23:34:34.942659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.942630    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:34:34.952482 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:34.952441    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w6-fb14dc-dockercfg-vkk6q\""
Oct 30 23:34:35.031643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.031544    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:34:35.031833 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.031755    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-622kh\" (UniqueName: \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:35.042655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.032004    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:35.042655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.035685    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:35.045240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.045213    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.103027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.102992    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-622kh\" (UniqueName: \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\") pod \"payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:35.108437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.108400    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:34:35.243649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.226524    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:35.249193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.247242    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlrb\" (UniqueName: \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.249193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.247434    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.371600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.348908    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.385504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.385459    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlrb\" (UniqueName: \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.389154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.388953    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.454741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.454568    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlrb\" (UniqueName: \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\") pod \"payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.670891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.670815    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:35.758652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:35.757282    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:34:35.758652 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:35.757751    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2e6889_92fb_45fb_aebd_f952c437cfd4.slice/crio-24bc7a5e9f3befa3d0ac9a5124b3c418cf805561a67822e855ee0dd5fbd4156f WatchSource:0}: Error finding container 24bc7a5e9f3befa3d0ac9a5124b3c418cf805561a67822e855ee0dd5fbd4156f: Status 404 returned error can't find the container with id 24bc7a5e9f3befa3d0ac9a5124b3c418cf805561a67822e855ee0dd5fbd4156f
Oct 30 23:34:36.084172 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:36.084130    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef44ff58_5f3c_4b09_9915_655beae5ee4d.slice/crio-ecff97f73925f9a710ffecbcea7b9646f9547a3f7fed3e2e0a7ba53d07b8642b WatchSource:0}: Error finding container ecff97f73925f9a710ffecbcea7b9646f9547a3f7fed3e2e0a7ba53d07b8642b: Status 404 returned error can't find the container with id ecff97f73925f9a710ffecbcea7b9646f9547a3f7fed3e2e0a7ba53d07b8642b
Oct 30 23:34:36.087609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.087580    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:34:36.419015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.418918    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" event={"ID":"ef44ff58-5f3c-4b09-9915-655beae5ee4d","Type":"ContainerStarted","Data":"a018ea9b19ef7a033a67a8fc13031d0a7355edfc10c93e2ee4fab14dba93e433"}
Oct 30 23:34:36.419015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.418978    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" event={"ID":"ef44ff58-5f3c-4b09-9915-655beae5ee4d","Type":"ContainerStarted","Data":"ecff97f73925f9a710ffecbcea7b9646f9547a3f7fed3e2e0a7ba53d07b8642b"}
Oct 30 23:34:36.419539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.419127    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:36.420839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.420812    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" event={"ID":"be2e6889-92fb-45fb-aebd-f952c437cfd4","Type":"ContainerStarted","Data":"063e8f3b102c2a78b0717073b8b944142b41d54b22ec6464b04c08244fd55371"}
Oct 30 23:34:36.420975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.420863    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" event={"ID":"be2e6889-92fb-45fb-aebd-f952c437cfd4","Type":"ContainerStarted","Data":"24bc7a5e9f3befa3d0ac9a5124b3c418cf805561a67822e855ee0dd5fbd4156f"}
Oct 30 23:34:36.420975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.420885    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:36.536289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.536234    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" podStartSLOduration=2.536219398 podStartE2EDuration="2.536219398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:36.53466303 +0000 UTC m=+1648.294755603" watchObservedRunningTime="2026-10-30 23:34:36.536219398 +0000 UTC m=+1648.296311969"
Oct 30 23:34:36.665723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:36.665674    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" podStartSLOduration=2.665659995 podStartE2EDuration="2.665659995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:36.662158051 +0000 UTC m=+1648.422250623" watchObservedRunningTime="2026-10-30 23:34:36.665659995 +0000 UTC m=+1648.425752565"
Oct 30 23:34:46.254857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.254817    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:34:46.261255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.261231    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.315387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.315355    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-59d267-openshift-default-dockercfg-4f544\""
Oct 30 23:34:46.341808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.341770    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342041    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342084    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342155    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342244    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342393    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342474    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342534    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.342605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.342568    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77gd\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.373300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.373263    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:34:46.444254 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444219    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444277    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444305    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444399    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444496    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444681    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444701    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444787    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444852    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444886    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77gd\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.444982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.444892    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.445087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.445060    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.445906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.445239    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.445906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.445850    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.447798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.447760    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.448815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.448796    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.554575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.554491    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77gd\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.558480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.558022    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\") pod \"e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") " pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:46.585389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:46.584153    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:47.069679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.069554    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:34:47.073116 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:47.073086    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe8ee21_259a_40af_afe7_c0833ba8692e.slice/crio-c02132196fef849a7ab0146b44556971b6fd629d7185996ac445789ec6a00143 WatchSource:0}: Error finding container c02132196fef849a7ab0146b44556971b6fd629d7185996ac445789ec6a00143: Status 404 returned error can't find the container with id c02132196fef849a7ab0146b44556971b6fd629d7185996ac445789ec6a00143
Oct 30 23:34:47.076266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.076234    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:47.076365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.076310    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:47.076365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.076342    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:47.233553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.233520    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:34:47.250218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.250163    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.258477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.258443    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plq79\" (UniqueName: \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.259067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.259048    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.331671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.331539    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1ce657\""
Oct 30 23:34:47.345975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.345942    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1ce657-dockercfg-8l2ds\""
Oct 30 23:34:47.365641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.358720    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:34:47.365641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.360924    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plq79\" (UniqueName: \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.365641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.361063    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.365641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.365480    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.389530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.389484    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:34:47.400698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.395592    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.448452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.439933    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:34:47.448452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.440014    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:34:47.448452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.440220    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plq79\" (UniqueName: \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\") pod \"payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.466516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.464273    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.466516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.464447    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2xln\" (UniqueName: \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.473252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.473224    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:34:47.587219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.579454    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:47.591227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.580230    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.591227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.590679    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2xln\" (UniqueName: \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.591227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.589057    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.668525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.667218    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerStarted","Data":"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"}
Oct 30 23:34:47.668525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.667344    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerStarted","Data":"c02132196fef849a7ab0146b44556971b6fd629d7185996ac445789ec6a00143"}
Oct 30 23:34:47.680708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.674656    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2xln\" (UniqueName: \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\") pod \"payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") " pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.727828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.727776    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:47.978220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:47.978166    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podStartSLOduration=1.978148391 podStartE2EDuration="1.978148391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:47.969075468 +0000 UTC m=+1659.729168040" watchObservedRunningTime="2026-10-30 23:34:47.978148391 +0000 UTC m=+1659.738240963"
Oct 30 23:34:48.224356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.224323    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:34:48.232994 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:48.232967    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736624fe_c7dd_4bf8_9e07_ad8ca40ba3b4.slice/crio-a3b3804c5de515243b326560be0ce97c5dbe77de2c0289a5df0cf0f06a680d51 WatchSource:0}: Error finding container a3b3804c5de515243b326560be0ce97c5dbe77de2c0289a5df0cf0f06a680d51: Status 404 returned error can't find the container with id a3b3804c5de515243b326560be0ce97c5dbe77de2c0289a5df0cf0f06a680d51
Oct 30 23:34:48.298871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.298841    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:34:48.304095 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:48.304044    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404863bf_6773_47a7_825a_e06296196bb7.slice/crio-4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b WatchSource:0}: Error finding container 4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b: Status 404 returned error can't find the container with id 4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b
Oct 30 23:34:48.585233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.585126    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:48.591719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.591687    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:48.675211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.675177    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" event={"ID":"404863bf-6773-47a7-825a-e06296196bb7","Type":"ContainerStarted","Data":"f50502cd118f091d9a30da2939938b63eb0e51bdc737da1f68ef91f4dbc97119"}
Oct 30 23:34:48.675405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.675239    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" event={"ID":"404863bf-6773-47a7-825a-e06296196bb7","Type":"ContainerStarted","Data":"4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b"}
Oct 30 23:34:48.675405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.675300    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:48.676714 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.676693    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" event={"ID":"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4","Type":"ContainerStarted","Data":"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"}
Oct 30 23:34:48.676822 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.676730    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" event={"ID":"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4","Type":"ContainerStarted","Data":"a3b3804c5de515243b326560be0ce97c5dbe77de2c0289a5df0cf0f06a680d51"}
Oct 30 23:34:48.677011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.676997    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:48.678064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.678049    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:34:48.952550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:48.952441    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" podStartSLOduration=1.9524257170000001 podStartE2EDuration="1.952425717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:48.950143552 +0000 UTC m=+1660.710236125" watchObservedRunningTime="2026-10-30 23:34:48.952425717 +0000 UTC m=+1660.712518287"
Oct 30 23:34:49.067266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:49.067205    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" podStartSLOduration=2.067186846 podStartE2EDuration="2.067186846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:49.065103991 +0000 UTC m=+1660.825196618" watchObservedRunningTime="2026-10-30 23:34:49.067186846 +0000 UTC m=+1660.827279419"
Oct 30 23:34:49.689927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:49.689895    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:34:53.636394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.636358    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:34:53.642268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.642250    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.695184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.695155    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-55666687-openshift-default-dockercfg-8kmlb\""
Oct 30 23:34:53.758014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.757977    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.758243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.758216    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.758337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.758299    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.758553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.758517    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.758735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.758573    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.758876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.758851    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.759778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.759438    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5drs\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.759778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.759508    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.759778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.759552    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.852402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.852363    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:34:53.861800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.861751    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.861968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.861804    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.861968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.861887    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.861987    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5drs\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862038    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862076    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862160    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862224    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862231    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.862371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.862346    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.863435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.863404    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.864180 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.864149    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.864401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.864375    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.864684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.864661    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.864909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.864884    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.866370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.866344    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.921225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.921089    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.921225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.921108    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5drs\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-84q9w\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:53.957793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:53.957765    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:54.401753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.399501    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:34:54.403494 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:34:54.403463    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b393ab3_1693_4e24_83cc_109dbbb88cbd.slice/crio-de8c4f03e28856f817671d22bb288b14f95cbb045a97479a79a7ffb7efcf9698 WatchSource:0}: Error finding container de8c4f03e28856f817671d22bb288b14f95cbb045a97479a79a7ffb7efcf9698: Status 404 returned error can't find the container with id de8c4f03e28856f817671d22bb288b14f95cbb045a97479a79a7ffb7efcf9698
Oct 30 23:34:54.406141 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.406096    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:54.406260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.406189    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:54.406260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.406230    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:34:54.744358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.744320    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" event={"ID":"9b393ab3-1693-4e24-83cc-109dbbb88cbd","Type":"ContainerStarted","Data":"9aca28259d6595fc706b3a255b203f90eb282969972019c6da5b55213b6e2488"}
Oct 30 23:34:54.745091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.744407    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" event={"ID":"9b393ab3-1693-4e24-83cc-109dbbb88cbd","Type":"ContainerStarted","Data":"de8c4f03e28856f817671d22bb288b14f95cbb045a97479a79a7ffb7efcf9698"}
Oct 30 23:34:54.958261 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:54.958226    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:34:55.960472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:55.960435    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Oct 30 23:34:55.960934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:55.960489    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Oct 30 23:34:56.958929 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:56.958896    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Oct 30 23:34:56.959188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:56.958963    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Oct 30 23:34:57.958458 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:57.958421    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Oct 30 23:34:57.958907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:57.958476    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Oct 30 23:34:58.958675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:58.958640    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Oct 30 23:34:58.959154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:58.958704    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Oct 30 23:34:59.721565 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:59.721531    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:34:59.839106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:59.839043    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podStartSLOduration=6.839027725 podStartE2EDuration="6.839027725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:54.864456027 +0000 UTC m=+1666.624548597" watchObservedRunningTime="2026-10-30 23:34:59.839027725 +0000 UTC m=+1671.599120296"
Oct 30 23:34:59.963080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:59.963038    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Oct 30 23:34:59.963590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:34:59.963103    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Oct 30 23:35:00.712515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:00.712487    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:35:00.966210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:00.966128    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:35:00.966682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:00.966555    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:35:00.967380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:00.967358    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:35:04.176648 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:04.174135    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:35:16.598508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.598476    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:35:16.599079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.598702    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy" containerID="cri-o://63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15" gracePeriod=30
Oct 30 23:35:16.650682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.650599    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:35:16.650887 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.650864    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" containerID="cri-o://5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a" gracePeriod=30
Oct 30 23:35:16.654768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.654742    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:35:16.922664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:16.922532    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy" containerID="cri-o://4f359aa24b97801bc72af2efe8717ed54fb4532e8f278ba2de991641a7050403" gracePeriod=30
Oct 30 23:35:17.163287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.163255    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:35:17.163511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.163482    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy" containerID="cri-o://06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845" gracePeriod=30
Oct 30 23:35:17.167308 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.167279    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:35:17.167533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.167509    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy" containerID="cri-o://db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc" gracePeriod=30
Oct 30 23:35:17.171161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.171136    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:35:17.171383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:17.171347    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" containerID="cri-o://fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99" gracePeriod=30
Oct 30 23:35:18.537159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:18.537107    6126 patch_prober.go:29] interesting pod/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:35:18.537589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:18.537173    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:35:20.326494 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.326462    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:35:20.327305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.327272    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" podUID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" containerName="maas-api" containerID="cri-o://45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882" gracePeriod=30
Oct 30 23:35:20.867060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.867029    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:35:20.987183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.982147    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") pod \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") "
Oct 30 23:35:20.987183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.982304    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\") pod \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") "
Oct 30 23:35:20.987183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.982395    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\" (UniqueName: \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\") pod \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") "
Oct 30 23:35:20.987183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.982436    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\") pod \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\" (UID: \"da2c770f-cc70-4ab0-a2c2-95b0040a4d49\") "
Oct 30 23:35:20.987183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.983768    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca" pod "da2c770f-cc70-4ab0-a2c2-95b0040a4d49" (UID: "da2c770f-cc70-4ab0-a2c2-95b0040a4d49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:20.997854 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.997816    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd" pod "da2c770f-cc70-4ab0-a2c2-95b0040a4d49" (UID: "da2c770f-cc70-4ab0-a2c2-95b0040a4d49"). InnerVolumeSpecName "kube-api-access-5tnnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:20.999317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:20.999274    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs" pod "da2c770f-cc70-4ab0-a2c2-95b0040a4d49" (UID: "da2c770f-cc70-4ab0-a2c2-95b0040a4d49"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:21.023644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.010076    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls" pod "da2c770f-cc70-4ab0-a2c2-95b0040a4d49" (UID: "da2c770f-cc70-4ab0-a2c2-95b0040a4d49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:21.062057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.058438    6126 patch_prober.go:29] interesting pod/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:35:21.062057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.058501    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:35:21.072253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.062558    6126 generic.go:356] "Generic (PLEG): container finished" podID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" containerID="45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882" exitCode=0
Oct 30 23:35:21.072253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.062729    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" event={"ID":"da2c770f-cc70-4ab0-a2c2-95b0040a4d49","Type":"ContainerDied","Data":"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"}
Oct 30 23:35:21.072253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.062782    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw" event={"ID":"da2c770f-cc70-4ab0-a2c2-95b0040a4d49","Type":"ContainerDied","Data":"7bee6e1bb0ca9bf376a940a40e8558af0472d32018881d3aaf2d41974e51a744"}
Oct 30 23:35:21.072253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.062811    6126 scope.go:122] "RemoveContainer" containerID="45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"
Oct 30 23:35:21.072253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.062978    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"
Oct 30 23:35:21.089040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.088416    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:21.089040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.088443    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:21.089040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.088457    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tnnd\" (UniqueName: \"kubernetes.io/projected/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-kube-api-access-5tnnd\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:21.089040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.088469    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c770f-cc70-4ab0-a2c2-95b0040a4d49-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:21.111856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.111823    6126 scope.go:122] "RemoveContainer" containerID="45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"
Oct 30 23:35:21.112289 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:21.112259    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882\": container with ID starting with 45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882 not found: ID does not exist" containerID="45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"
Oct 30 23:35:21.112398 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.112297    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882"} err="failed to get container status \"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882\": rpc error: code = NotFound desc = could not find container \"45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882\": container with ID starting with 45b1c12f9aea2154212fda4f19669dda9f263fc79c1b20145fae8bd67854d882 not found: ID does not exist"
Oct 30 23:35:21.250333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.250248    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:35:21.253805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.253784    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-20f33adb-689fdb57b9-qkrvw"]
Oct 30 23:35:21.930270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:21.930246    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:35:22.006021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.005991    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006042    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006145    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006281    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006322    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006430    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006474    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006515    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.006791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006546    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.006791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006586    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.006791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006657    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:22.006791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006702    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\") pod \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\" (UID: \"4f57cb42-e295-46b0-91fb-de1592cc4ce3\") "
Oct 30 23:35:22.007244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006816    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.007244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.006964    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.007422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.007400    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.007492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.007423    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.007492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.007436    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.007492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.007448    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.007492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.007457    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.008414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.008393    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:22.008583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.008565    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.009172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.009156    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.009298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.009282    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524" pod "4f57cb42-e295-46b0-91fb-de1592cc4ce3" (UID: "4f57cb42-e295-46b0-91fb-de1592cc4ce3"). InnerVolumeSpecName "kube-api-access-rq524". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.037259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.037233    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:35:22.083819 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.083780    6126 generic.go:356] "Generic (PLEG): container finished" podID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerID="63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15" exitCode=0
Oct 30 23:35:22.084105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.084089    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"
Oct 30 23:35:22.085041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.084843    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" event={"ID":"4f57cb42-e295-46b0-91fb-de1592cc4ce3","Type":"ContainerDied","Data":"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"}
Oct 30 23:35:22.085041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.084920    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm" event={"ID":"4f57cb42-e295-46b0-91fb-de1592cc4ce3","Type":"ContainerDied","Data":"03f116840e422fbcfdbde7ca769e103ead77d107c93a4b3f5d6c921cf9c539d3"}
Oct 30 23:35:22.085041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.084949    6126 scope.go:122] "RemoveContainer" containerID="63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"
Oct 30 23:35:22.090549 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.090524    6126 generic.go:356] "Generic (PLEG): container finished" podID="f71e5032-d316-4096-be0b-2ac0ca694265" containerID="4f359aa24b97801bc72af2efe8717ed54fb4532e8f278ba2de991641a7050403" exitCode=0
Oct 30 23:35:22.090883 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.090603    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" event={"ID":"f71e5032-d316-4096-be0b-2ac0ca694265","Type":"ContainerDied","Data":"4f359aa24b97801bc72af2efe8717ed54fb4532e8f278ba2de991641a7050403"}
Oct 30 23:35:22.096953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.096920    6126 generic.go:356] "Generic (PLEG): container finished" podID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerID="5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a" exitCode=0
Oct 30 23:35:22.097075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.096968    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" event={"ID":"366e3138-e246-4b7e-b84a-cd50f3bbdecb","Type":"ContainerDied","Data":"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"}
Oct 30 23:35:22.097159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.097137    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg" event={"ID":"366e3138-e246-4b7e-b84a-cd50f3bbdecb","Type":"ContainerDied","Data":"ca4ba77ed0fd5d149157f0d28be7e8f4acae0726119f5dcfd1f6135a4f6f6e4a"}
Oct 30 23:35:22.097219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.096997    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"
Oct 30 23:35:22.103397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.103378    6126 scope.go:122] "RemoveContainer" containerID="63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"
Oct 30 23:35:22.103734 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:22.103711    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15\": container with ID starting with 63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15 not found: ID does not exist" containerID="63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"
Oct 30 23:35:22.103821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.103741    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15"} err="failed to get container status \"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15\": rpc error: code = NotFound desc = could not find container \"63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15\": container with ID starting with 63ddda6f3d960b6e63407a1a784aa786b64e96df7ed3d18cb7b3f3a0789ebe15 not found: ID does not exist"
Oct 30 23:35:22.103821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.103760    6126 scope.go:122] "RemoveContainer" containerID="5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"
Oct 30 23:35:22.108207 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108183    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108229    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108266    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108365    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108652    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108722    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108788    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108865    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.108937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.108921    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\") pod \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\" (UID: \"366e3138-e246-4b7e-b84a-cd50f3bbdecb\") "
Oct 30 23:35:22.110094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.109914    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.110094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110014    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.110094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110038    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.110094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110053    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.110094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110067    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq524\" (UniqueName: \"kubernetes.io/projected/4f57cb42-e295-46b0-91fb-de1592cc4ce3-kube-api-access-rq524\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.110409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110367    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:22.110599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110516    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.110599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110578    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.110970 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.110950    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.114418 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.114391    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.118512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.118490    6126 scope.go:122] "RemoveContainer" containerID="5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"
Oct 30 23:35:22.119172 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:22.119144    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a\": container with ID starting with 5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a not found: ID does not exist" containerID="5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"
Oct 30 23:35:22.119319 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.119185    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a"} err="failed to get container status \"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a\": rpc error: code = NotFound desc = could not find container \"5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a\": container with ID starting with 5ee9e66918c4e853edcc1cae59cc9718687f2410e79e6a0fbc08ddca9769b09a not found: ID does not exist"
Oct 30 23:35:22.120988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.120963    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:22.121538 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.121515    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "kube-api-access-z2jpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.122958 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.122924    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token" pod "366e3138-e246-4b7e-b84a-cd50f3bbdecb" (UID: "366e3138-e246-4b7e-b84a-cd50f3bbdecb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211469    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211498    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211508    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211521    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211536    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211559    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211572    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/366e3138-e246-4b7e-b84a-cd50f3bbdecb-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211583    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2jpv\" (UniqueName: \"kubernetes.io/projected/366e3138-e246-4b7e-b84a-cd50f3bbdecb-kube-api-access-z2jpv\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.213606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.211593    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/366e3138-e246-4b7e-b84a-cd50f3bbdecb-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.359746 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.359331    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:35:22.384315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.384252    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:35:22.390852 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.390809    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-46cnm"]
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.417485    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" path="/var/lib/kubelet/pods/4f57cb42-e295-46b0-91fb-de1592cc4ce3/volumes"
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420026    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420086    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420153    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420195    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420284    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420329    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420400    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420475    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.420499    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\") pod \"f71e5032-d316-4096-be0b-2ac0ca694265\" (UID: \"f71e5032-d316-4096-be0b-2ac0ca694265\") "
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.421782    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.422924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.422519    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" path="/var/lib/kubelet/pods/da2c770f-cc70-4ab0-a2c2-95b0040a4d49/volumes"
Oct 30 23:35:22.424468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.424168    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.428906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.424851    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.428906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.425092    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.429084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.428944    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:22.429477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.429245    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:22.436223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.436189    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "kube-api-access-c992k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.436321 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.436261    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.438197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.438128    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token" pod "f71e5032-d316-4096-be0b-2ac0ca694265" (UID: "f71e5032-d316-4096-be0b-2ac0ca694265"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524039    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f71e5032-d316-4096-be0b-2ac0ca694265-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524073    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524088    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c992k\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-kube-api-access-c992k\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524103    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524117    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524131    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524144    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f71e5032-d316-4096-be0b-2ac0ca694265-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524157    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f71e5032-d316-4096-be0b-2ac0ca694265-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.524525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.524171    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71e5032-d316-4096-be0b-2ac0ca694265-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.622256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.621892    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:35:22.809910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.804707    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:35:22.817602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.817559    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-zmtrg"]
Oct 30 23:35:22.836056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.836014    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.836487    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.836334    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837043    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837105    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837153    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837250    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837326    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837483    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.837677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.837558    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\") pod \"af37cb44-eaed-4066-9987-deceb2b12755\" (UID: \"af37cb44-eaed-4066-9987-deceb2b12755\") "
Oct 30 23:35:22.838424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.838254    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.839590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.839539    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:22.840401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.840360    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.841154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.840674    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:22.841154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.841113    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.841544 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.841513    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.844508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.844471    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "kube-api-access-swwk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.846177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.846142    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:22.846327 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.846301    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token" pod "af37cb44-eaed-4066-9987-deceb2b12755" (UID: "af37cb44-eaed-4066-9987-deceb2b12755"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:22.887077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.887045    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:35:22.894010 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.893980    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:35:22.939396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939360    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af37cb44-eaed-4066-9987-deceb2b12755-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939393    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939408    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swwk6\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-kube-api-access-swwk6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939422    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939435    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af37cb44-eaed-4066-9987-deceb2b12755-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939448    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939460    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af37cb44-eaed-4066-9987-deceb2b12755-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:22.939858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:22.939474    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af37cb44-eaed-4066-9987-deceb2b12755-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.040232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040195    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.040401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040287    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040341    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040375    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.040588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040404    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040463    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.040588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040513    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.040799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040691    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040770    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040831    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.040901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040867    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040901    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.040998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.040949    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.041097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041084    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.041159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041111    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.041215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041190    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.041270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041220    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\") pod \"5721e040-9402-4c8a-9a79-fdd346e80f2c\" (UID: \"5721e040-9402-4c8a-9a79-fdd346e80f2c\") "
Oct 30 23:35:23.041270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041254    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\") pod \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\" (UID: \"a84c1af7-1616-4ac1-b4fd-e440d015ab54\") "
Oct 30 23:35:23.041793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041761    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.041924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041883    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:23.042006 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.041985    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.042263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.042240    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.042324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.042270    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.042324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.042285    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.042500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.042362    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.042691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.042589    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.043038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.043010    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.043127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.043047    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:23.043564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.043539    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.043808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.043785    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.043900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.043887    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.044527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.044495    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.047385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.047354    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:23.048125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.048085    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:23.048125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.048106    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "kube-api-access-4gtk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:23.048276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.048139    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:23.048785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.048748    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4" pod "5721e040-9402-4c8a-9a79-fdd346e80f2c" (UID: "5721e040-9402-4c8a-9a79-fdd346e80f2c"). InnerVolumeSpecName "kube-api-access-4m6p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:23.049989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.049966    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:23.050118 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.050081    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token" pod "a84c1af7-1616-4ac1-b4fd-e440d015ab54" (UID: "a84c1af7-1616-4ac1-b4fd-e440d015ab54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:23.105995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.105959    6126 generic.go:356] "Generic (PLEG): container finished" podID="af37cb44-eaed-4066-9987-deceb2b12755" containerID="db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc" exitCode=0
Oct 30 23:35:23.106175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.106004    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"
Oct 30 23:35:23.106175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.106080    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" event={"ID":"af37cb44-eaed-4066-9987-deceb2b12755","Type":"ContainerDied","Data":"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"}
Oct 30 23:35:23.106175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.106135    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b" event={"ID":"af37cb44-eaed-4066-9987-deceb2b12755","Type":"ContainerDied","Data":"20685b46d20c8354667e12902f00991af11fa6e1b83134f0c0c7430de1809ae8"}
Oct 30 23:35:23.106175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.106162    6126 scope.go:122] "RemoveContainer" containerID="db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"
Oct 30 23:35:23.107633 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.107590    6126 generic.go:356] "Generic (PLEG): container finished" podID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerID="fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99" exitCode=0
Oct 30 23:35:23.107786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.107683    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"
Oct 30 23:35:23.107786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.107692    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" event={"ID":"5721e040-9402-4c8a-9a79-fdd346e80f2c","Type":"ContainerDied","Data":"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"}
Oct 30 23:35:23.107786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.107740    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x" event={"ID":"5721e040-9402-4c8a-9a79-fdd346e80f2c","Type":"ContainerDied","Data":"1c4fc075dcb2a0b6fa382863d90acf8ecba037ca639abf4237a61f5dc29d6fab"}
Oct 30 23:35:23.109396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.109376    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"
Oct 30 23:35:23.109396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.109387    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4" event={"ID":"f71e5032-d316-4096-be0b-2ac0ca694265","Type":"ContainerDied","Data":"7861b76cd179f14e70736a6ddd3940db539b988f1b93272d892da33f1277e29c"}
Oct 30 23:35:23.112341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.112317    6126 generic.go:356] "Generic (PLEG): container finished" podID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerID="06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845" exitCode=0
Oct 30 23:35:23.112464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.112361    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"
Oct 30 23:35:23.112464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.112390    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" event={"ID":"a84c1af7-1616-4ac1-b4fd-e440d015ab54","Type":"ContainerDied","Data":"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"}
Oct 30 23:35:23.112464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.112439    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs" event={"ID":"a84c1af7-1616-4ac1-b4fd-e440d015ab54","Type":"ContainerDied","Data":"7bbc234aef12aae669df34b30205a02cea516a849943692fce418d8ecd9a86fa"}
Oct 30 23:35:23.121194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.121178    6126 scope.go:122] "RemoveContainer" containerID="db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"
Oct 30 23:35:23.121511 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:23.121491    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc\": container with ID starting with db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc not found: ID does not exist" containerID="db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"
Oct 30 23:35:23.121592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.121521    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc"} err="failed to get container status \"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc\": rpc error: code = NotFound desc = could not find container \"db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc\": container with ID starting with db51a2537f32b10c02dc22ef699d80fba34d1c673f321a1535b271a17e4f9abc not found: ID does not exist"
Oct 30 23:35:23.121592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.121556    6126 scope.go:122] "RemoveContainer" containerID="fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"
Oct 30 23:35:23.143955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.143920    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.143955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.143958    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.143974    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5721e040-9402-4c8a-9a79-fdd346e80f2c-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.143988    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m6p4\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-kube-api-access-4m6p4\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144004    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144017    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gtk4\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-kube-api-access-4gtk4\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144031    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144043    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144056    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144068    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144081    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5721e040-9402-4c8a-9a79-fdd346e80f2c-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144095    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a84c1af7-1616-4ac1-b4fd-e440d015ab54-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144108    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84c1af7-1616-4ac1-b4fd-e440d015ab54-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144121    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.144204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.144137    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5721e040-9402-4c8a-9a79-fdd346e80f2c-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:23.147063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.147038    6126 scope.go:122] "RemoveContainer" containerID="fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"
Oct 30 23:35:23.147438 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:23.147419    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99\": container with ID starting with fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99 not found: ID does not exist" containerID="fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"
Oct 30 23:35:23.147508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.147445    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99"} err="failed to get container status \"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99\": rpc error: code = NotFound desc = could not find container \"fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99\": container with ID starting with fc885ba7255cb25dcb70776bf76f2ff3fc466cf696628934c75a38ca7e6dcd99 not found: ID does not exist"
Oct 30 23:35:23.147508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.147463    6126 scope.go:122] "RemoveContainer" containerID="4f359aa24b97801bc72af2efe8717ed54fb4532e8f278ba2de991641a7050403"
Oct 30 23:35:23.159115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.159093    6126 scope.go:122] "RemoveContainer" containerID="06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"
Oct 30 23:35:23.172313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.172290    6126 scope.go:122] "RemoveContainer" containerID="06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"
Oct 30 23:35:23.172689 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:23.172667    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845\": container with ID starting with 06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845 not found: ID does not exist" containerID="06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"
Oct 30 23:35:23.172846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.172817    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845"} err="failed to get container status \"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845\": rpc error: code = NotFound desc = could not find container \"06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845\": container with ID starting with 06a5693203125705355e96266864b176503d256bed7562aa4498cc3bb3f11845 not found: ID does not exist"
Oct 30 23:35:23.255456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.255423    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:35:23.258749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.258709    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-rrg2b"]
Oct 30 23:35:23.373611 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.373534    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:35:23.376836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.376812    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-7r6c4"]
Oct 30 23:35:23.490847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.490813    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:35:23.496014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.495983    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-s7d6x"]
Oct 30 23:35:23.611258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.611205    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:35:23.614988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:23.614962    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-4l8cs"]
Oct 30 23:35:24.023070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.023024    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:35:24.024201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024174    6126 cpu_manager.go:414] "containerMap: removing container" podUID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" containerName="maas-api"
Oct 30 23:35:24.024201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024198    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" containerName="maas-api"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024221    6126 cpu_manager.go:414] "containerMap: removing container" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024229    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024248    6126 cpu_manager.go:414] "containerMap: removing container" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024256    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024273    6126 cpu_manager.go:414] "containerMap: removing container" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024280    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024318    6126 cpu_manager.go:414] "containerMap: removing container" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy"
Oct 30 23:35:24.024345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024326    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy"
Oct 30 23:35:24.024582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024414    6126 cpu_manager.go:414] "containerMap: removing container" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy"
Oct 30 23:35:24.024582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024422    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy"
Oct 30 23:35:24.024582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024482    6126 cpu_manager.go:414] "containerMap: removing container" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy"
Oct 30 23:35:24.024582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024490    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy"
Oct 30 23:35:24.024830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024802    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="af37cb44-eaed-4066-9987-deceb2b12755" containerName="istio-proxy"
Oct 30 23:35:24.024830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024828    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f57cb42-e295-46b0-91fb-de1592cc4ce3" containerName="istio-proxy"
Oct 30 23:35:24.024908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024839    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" containerName="istio-proxy"
Oct 30 23:35:24.024908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024859    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="da2c770f-cc70-4ab0-a2c2-95b0040a4d49" containerName="maas-api"
Oct 30 23:35:24.024908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024871    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" containerName="istio-proxy"
Oct 30 23:35:24.024908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024882    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" containerName="istio-proxy"
Oct 30 23:35:24.024908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.024891    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" containerName="istio-proxy"
Oct 30 23:35:24.031197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.031174    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064507 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064466    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064507 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064500    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8gmf\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064598    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064748    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064779    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.064898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064819    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.065008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064911    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.065008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.064970    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.065115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.065038    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.091132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.091086    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:35:24.104875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.104845    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-557e9b-openshift-default-dockercfg-z4t8f\""
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.169549    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.169658    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.169717    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.169754    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.170021    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.170175    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.170559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.170187    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.171547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.171509    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.172877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.172857    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.173029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.172735    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.173126 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.173019    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8gmf\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.173354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.173306    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.173486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.173305    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.174673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.174644    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.175113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.175098    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.180006 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.179987    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.231138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.231072    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.235449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.235421    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8gmf\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\") pod \"e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") " pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.349045 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.348959    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:24.419297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.419251    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="366e3138-e246-4b7e-b84a-cd50f3bbdecb" path="/var/lib/kubelet/pods/366e3138-e246-4b7e-b84a-cd50f3bbdecb/volumes"
Oct 30 23:35:24.420223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.420198    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5721e040-9402-4c8a-9a79-fdd346e80f2c" path="/var/lib/kubelet/pods/5721e040-9402-4c8a-9a79-fdd346e80f2c/volumes"
Oct 30 23:35:24.421015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.420991    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a84c1af7-1616-4ac1-b4fd-e440d015ab54" path="/var/lib/kubelet/pods/a84c1af7-1616-4ac1-b4fd-e440d015ab54/volumes"
Oct 30 23:35:24.421921 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.421899    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af37cb44-eaed-4066-9987-deceb2b12755" path="/var/lib/kubelet/pods/af37cb44-eaed-4066-9987-deceb2b12755/volumes"
Oct 30 23:35:24.422391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.422375    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f71e5032-d316-4096-be0b-2ac0ca694265" path="/var/lib/kubelet/pods/f71e5032-d316-4096-be0b-2ac0ca694265/volumes"
Oct 30 23:35:24.812812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.812782    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:35:24.814206 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:24.814176    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb8b9c8_d6ed_4554_8dde_5f32f5598d74.slice/crio-67e6fd3d69f60fc862d69997b1dd6b7cdfdb41cbb9b3b71ca3022f20529abcde WatchSource:0}: Error finding container 67e6fd3d69f60fc862d69997b1dd6b7cdfdb41cbb9b3b71ca3022f20529abcde: Status 404 returned error can't find the container with id 67e6fd3d69f60fc862d69997b1dd6b7cdfdb41cbb9b3b71ca3022f20529abcde
Oct 30 23:35:24.816978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.816941    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:24.817087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.817026    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:24.817087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:24.817057    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:25.180530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:25.180125    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerStarted","Data":"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"}
Oct 30 23:35:25.180530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:25.180187    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerStarted","Data":"67e6fd3d69f60fc862d69997b1dd6b7cdfdb41cbb9b3b71ca3022f20529abcde"}
Oct 30 23:35:25.300779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:25.300731    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podStartSLOduration=2.300715264 podStartE2EDuration="2.300715264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:25.298906605 +0000 UTC m=+1697.058999176" watchObservedRunningTime="2026-10-30 23:35:25.300715264 +0000 UTC m=+1697.060807837"
Oct 30 23:35:25.349114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:25.349083    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:25.356029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:25.356003    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:26.189555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:26.189525    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:26.190515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:26.190492    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:35:27.242300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.242258    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:35:27.248907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.248875    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.302160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.302129    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:35:27.322717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.322670    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.322885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.322723    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plsm6\" (UniqueName: \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.322885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.322855    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.323035 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.322927    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.347771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.347733    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w6-fb14dc-serving-cert\""
Oct 30 23:35:27.424973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.424933    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.425148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.424996    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plsm6\" (UniqueName: \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.425148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.425068    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.425148 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:27.425114    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-serving-cert: secret "maas-api-e2e-shared-a-w6-fb14dc-serving-cert" not found
Oct 30 23:35:27.425353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.425173    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.425353 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:27.425198    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls podName:dea6d8a3-e3d3-4599-91f0-345e35b9bd6c nodeName:}" failed. No retries permitted until 2026-10-30 23:35:27.925177033 +0000 UTC m=+1699.685269597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls") pod "maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" (UID: "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c") : secret "maas-api-e2e-shared-a-w6-fb14dc-serving-cert" not found
Oct 30 23:35:27.425920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.425859    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.427964 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.427933    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.488013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.487958    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsm6\" (UniqueName: \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.738365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.738337    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:35:27.742904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.742886    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.798662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.798548    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-55666687\"/\"openshift-service-ca.crt\""
Oct 30 23:35:27.798662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.798547    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-55666687\"/\"kube-root-ca.crt\""
Oct 30 23:35:27.798662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.798590    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-55666687\"/\"default-dockercfg-k97nh\""
Oct 30 23:35:27.798662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.798580    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-55666687\"/\"e2e-lifecycle-model-55666687-kserve-self-signed-certs\""
Oct 30 23:35:27.803047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.803021    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:35:27.832205 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832166    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wfz7\" (UniqueName: \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.832406 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832377    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.832479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832419    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.832743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832721    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.832823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832767    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.832968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.832931    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935124    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935173    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935298    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.935485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935371    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935409    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935511    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.935916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.935894    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.936065 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.936030    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wfz7\" (UniqueName: \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.936065 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.936056    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.936321 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.936281    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.940755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.940632    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.940903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.940863    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:27.943399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.943370    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:27.995950 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:27.995844    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wfz7\" (UniqueName: \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\") pod \"e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") " pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:28.058283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:28.058240    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:28.170960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:28.170049    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:28.486743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:28.486583    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:35:28.661363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:28.661330    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:35:28.662206 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:28.662171    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea6d8a3_e3d3_4599_91f0_345e35b9bd6c.slice/crio-ab6ac030420aab545d0947f27abb08a54d42075ac430afff88de3968d9fb2975 WatchSource:0}: Error finding container ab6ac030420aab545d0947f27abb08a54d42075ac430afff88de3968d9fb2975: Status 404 returned error can't find the container with id ab6ac030420aab545d0947f27abb08a54d42075ac430afff88de3968d9fb2975
Oct 30 23:35:29.238002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:29.237968    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" event={"ID":"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c","Type":"ContainerStarted","Data":"ab6ac030420aab545d0947f27abb08a54d42075ac430afff88de3968d9fb2975"}
Oct 30 23:35:29.240444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:29.240419    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" event={"ID":"d025dcce-36ff-4fce-83cf-b1aeb47cc260","Type":"ContainerStarted","Data":"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"}
Oct 30 23:35:29.240605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:29.240448    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" event={"ID":"d025dcce-36ff-4fce-83cf-b1aeb47cc260","Type":"ContainerStarted","Data":"e9cbf242e0e009aa673f1287523237e9a3bacbd9d58124d3b4c68bab33f974d6"}
Oct 30 23:35:29.359210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:29.359160    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" podStartSLOduration=2.35914554 podStartE2EDuration="2.35914554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:29.357448727 +0000 UTC m=+1701.117541299" watchObservedRunningTime="2026-10-30 23:35:29.35914554 +0000 UTC m=+1701.119238150"
Oct 30 23:35:30.058891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:30.058853    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:30.250906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:30.250863    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" event={"ID":"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c","Type":"ContainerStarted","Data":"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"}
Oct 30 23:35:30.251085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:30.250945    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:30.402450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:30.402341    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" podStartSLOduration=2.595110483 podStartE2EDuration="3.40232808s" totalImagesPullingTime="807.217597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:30.398344273 +0000 UTC m=+1702.158436846" watchObservedRunningTime="2026-10-30 23:35:30.40232808 +0000 UTC m=+1702.162420652"
Oct 30 23:35:33.188951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.188914    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:35:33.189448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.189241    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" containerID="cri-o://cc1eeae8967910c3bfbaadc78c326fc60c0a9ea29fbfb14bf079dda187942748" gracePeriod=30
Oct 30 23:35:33.236233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.236203    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:35:33.236480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.236436    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" containerID="cri-o://375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3" gracePeriod=30
Oct 30 23:35:33.239998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.239969    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:35:33.240183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.240157    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" containerID="cri-o://044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634" gracePeriod=30
Oct 30 23:35:33.301642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.288609    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:35:33.301642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.288860    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy" containerID="cri-o://7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7" gracePeriod=30
Oct 30 23:35:33.569440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.569407    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:35:33.574161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.574141    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.627947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.627914    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-557e9b-dockercfg-vb9rj\""
Oct 30 23:35:33.628140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.628081    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-557e9b\""
Oct 30 23:35:33.638651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.632767    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:35:33.694824 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.694774    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brf4\" (UniqueName: \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.695268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.695242    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.723885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.722247    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:35:33.729951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.728058    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:33.785497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.785460    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:35:33.800658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.797029    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brf4\" (UniqueName: \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.800658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.797234    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.813018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.802278    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.871726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.871444    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brf4\" (UniqueName: \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\") pod \"payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.903641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.893919    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:33.903641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.902126    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:33.903641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:33.902221    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpfk8\" (UniqueName: \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.005667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.004075    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpfk8\" (UniqueName: \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.005667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.004381    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.005667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.005302    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.064224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.064186    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpfk8\" (UniqueName: \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\") pod \"payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.155965 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:34.155819    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:35:34.306039 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.306006    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:35:34.306497 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:34.306457    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e86d5a_3723_4f52_aed3_b75948b83543.slice/crio-ce82228aea468071dd2240823df5f720f6e303c1738b89f33f3a723d42a14a3d WatchSource:0}: Error finding container ce82228aea468071dd2240823df5f720f6e303c1738b89f33f3a723d42a14a3d: Status 404 returned error can't find the container with id ce82228aea468071dd2240823df5f720f6e303c1738b89f33f3a723d42a14a3d
Oct 30 23:35:34.351362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.351331    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:34.747246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:34.747216    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:35:34.748356 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:34.748331    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ca9dfb_6c91_4e9c_9335_eb71c6ba6198.slice/crio-56f2c28099b264657f6284c9961b4c69fb084cbc071ed3b72955cf00ff388507 WatchSource:0}: Error finding container 56f2c28099b264657f6284c9961b4c69fb084cbc071ed3b72955cf00ff388507: Status 404 returned error can't find the container with id 56f2c28099b264657f6284c9961b4c69fb084cbc071ed3b72955cf00ff388507
Oct 30 23:35:35.291125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.291083    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" event={"ID":"f0e86d5a-3723-4f52-aed3-b75948b83543","Type":"ContainerStarted","Data":"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"}
Oct 30 23:35:35.291351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.291216    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" event={"ID":"f0e86d5a-3723-4f52-aed3-b75948b83543","Type":"ContainerStarted","Data":"ce82228aea468071dd2240823df5f720f6e303c1738b89f33f3a723d42a14a3d"}
Oct 30 23:35:35.291351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.291250    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:35.293330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.293304    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" event={"ID":"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198","Type":"ContainerStarted","Data":"2b58d0f3e6a4aecdd3ebc9c733c800a25f7b365565ca6c5de0ebeba115560a8c"}
Oct 30 23:35:35.293486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.293346    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" event={"ID":"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198","Type":"ContainerStarted","Data":"56f2c28099b264657f6284c9961b4c69fb084cbc071ed3b72955cf00ff388507"}
Oct 30 23:35:35.293486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.293397    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:35.410672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.410592    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" podStartSLOduration=2.410573532 podStartE2EDuration="2.410573532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:35.407328626 +0000 UTC m=+1707.167421198" watchObservedRunningTime="2026-10-30 23:35:35.410573532 +0000 UTC m=+1707.170666105"
Oct 30 23:35:35.529722 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:35.529655    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" podStartSLOduration=2.529603434 podStartE2EDuration="2.529603434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:35.527719753 +0000 UTC m=+1707.287812328" watchObservedRunningTime="2026-10-30 23:35:35.529603434 +0000 UTC m=+1707.289696007"
Oct 30 23:35:36.263071 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:36.263035    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:35:37.419441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.419403    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:35:37.425340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.425309    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.478324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.478293    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:35:37.523831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.523795    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1ce657-serving-cert\""
Oct 30 23:35:37.564448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.564408    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.564659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.564575    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.564736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.564658    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwp84\" (UniqueName: \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.564830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.564805    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.666811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.666736    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.667066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.666856    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.667066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.666921    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwp84\" (UniqueName: \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.667066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.667025    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.668131 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:37.667800    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-serving-cert: secret "maas-api-e2e-api-a-1ce657-serving-cert" not found
Oct 30 23:35:37.668131 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:37.667891    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls podName:1f8d7623-86bf-4e6d-9edd-3ff62c13f398 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:38.167869196 +0000 UTC m=+1709.927961764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls") pod "maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" (UID: "1f8d7623-86bf-4e6d-9edd-3ff62c13f398") : secret "maas-api-e2e-api-a-1ce657-serving-cert" not found
Oct 30 23:35:37.669866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.669347    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.670672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.670629    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:37.726674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:37.726607    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwp84\" (UniqueName: \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:38.030244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.030205    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:35:38.030423 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.030276    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:35:38.059357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.059322    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:38.071673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.071644    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:38.175258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.175224    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:38.177910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.177888    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") pod \"maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:38.328496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.328456    6126 generic.go:356] "Generic (PLEG): container finished" podID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerID="cc1eeae8967910c3bfbaadc78c326fc60c0a9ea29fbfb14bf079dda187942748" exitCode=0
Oct 30 23:35:38.330137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.330108    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" event={"ID":"7ef657dd-653f-4443-891c-5f7fdb795d8a","Type":"ContainerDied","Data":"cc1eeae8967910c3bfbaadc78c326fc60c0a9ea29fbfb14bf079dda187942748"}
Oct 30 23:35:38.342351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.342327    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:38.342486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.342409    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:35:38.622447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.622266    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:35:38.708467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.707694    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.708467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.708280    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.708467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.708456    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.708980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.708934    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.709485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.709452    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.709877    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.709988    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.710018    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.710093    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.710137    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.710409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.710255    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\") pod \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\" (UID: \"047a7acb-ecab-49ea-85ec-19ade8bf6a92\") "
Oct 30 23:35:38.713864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.711471    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.713864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.712188    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.713864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.713421    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.713864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.713823    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714913    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714939    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714955    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714968    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714980    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.715050 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.714995    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.717253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.717219    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.717906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.717874    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "kube-api-access-597hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.735689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.735640    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy" pod "047a7acb-ecab-49ea-85ec-19ade8bf6a92" (UID: "047a7acb-ecab-49ea-85ec-19ade8bf6a92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.781812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.781465    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:35:38.816208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.815917    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.815995    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816058    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816123    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816208 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816152    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816252    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816329    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816413    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.816586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816510    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\") pod \"7ef657dd-653f-4443-891c-5f7fdb795d8a\" (UID: \"7ef657dd-653f-4443-891c-5f7fdb795d8a\") "
Oct 30 23:35:38.817667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.816956    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.817667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.817339    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.817667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.817355    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-597hz\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-kube-api-access-597hz\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.817667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.817364    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047a7acb-ecab-49ea-85ec-19ade8bf6a92-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.817667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.817373    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.818530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.818294    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.819151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.819113    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.819430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.819397    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:38.819780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.819751    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.821777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.821740    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.826428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.826304    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "kube-api-access-bpr98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.826428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.826378    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.833967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.833899    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo" pod "7ef657dd-653f-4443-891c-5f7fdb795d8a" (UID: "7ef657dd-653f-4443-891c-5f7fdb795d8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:38.844559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.844471    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:35:38.847159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.847079    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920080    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920164    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920196    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920291    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920319    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920363    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920396    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920444    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920482    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920522    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920575    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.920894    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921084    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921162    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921228    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921283    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\") pod \"ebef83cd-b6f7-4614-88d1-52949505d39c\" (UID: \"ebef83cd-b6f7-4614-88d1-52949505d39c\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921338    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921396    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921422    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\") pod \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\" (UID: \"9ad00c7d-34c5-42d8-86f9-3aa430a75039\") "
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921550    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921674    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.921995    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.922245    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.922644    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.922759    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.923679    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.923978    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.924448    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.925365    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926014    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926037    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926055    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926068    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebef83cd-b6f7-4614-88d1-52949505d39c-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926081    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926095    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926036    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926109    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926154    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926173    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926188    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926203    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926217    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926231    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpr98\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-kube-api-access-bpr98\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926246    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926259    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ef657dd-653f-4443-891c-5f7fdb795d8a-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926272    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926288    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926301    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.927690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.926315    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ef657dd-653f-4443-891c-5f7fdb795d8a-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:38.930432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.928716    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:35:38.930432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.929805    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "kube-api-access-nqwnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.930551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.930479    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:38.932087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.932006    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:35:38.932224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.932095    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token" pod "9ad00c7d-34c5-42d8-86f9-3aa430a75039" (UID: "9ad00c7d-34c5-42d8-86f9-3aa430a75039"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.932224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.932205    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh" pod "ebef83cd-b6f7-4614-88d1-52949505d39c" (UID: "ebef83cd-b6f7-4614-88d1-52949505d39c"). InnerVolumeSpecName "kube-api-access-bd2bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:38.970843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.970808    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:35:38.971674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971652    6126 cpu_manager.go:414] "containerMap: removing container" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy"
Oct 30 23:35:38.971674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971673    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971689    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971697    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971722    6126 cpu_manager.go:414] "containerMap: removing container" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971727    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971762    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy"
Oct 30 23:35:38.971863 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971767    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy"
Oct 30 23:35:38.972048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971884    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy"
Oct 30 23:35:38.972048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971896    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:38.972048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971905    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerName="istio-proxy"
Oct 30 23:35:38.972048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971912    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerName="istio-proxy"
Oct 30 23:35:38.972048 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.971921    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:38.977002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:38.976984    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.028651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028589    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.028916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028668    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.028916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028744    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.028916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028821    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.028916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028894    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028919    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.028972    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029034    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlxs\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029070    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029265    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqwnb\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-kube-api-access-nqwnb\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029287    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029301    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029314    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd2bh\" (UniqueName: \"kubernetes.io/projected/ebef83cd-b6f7-4614-88d1-52949505d39c-kube-api-access-bd2bh\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029328    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebef83cd-b6f7-4614-88d1-52949505d39c-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029341    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.029974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.029354    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad00c7d-34c5-42d8-86f9-3aa430a75039-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:35:39.031152 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:39.031099    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8d7623_86bf_4e6d_9edd_3ff62c13f398.slice/crio-4f3ef93ccf6698b86f58e71af8c4e1db098a5c8b93561ffede0c744e54a3212a WatchSource:0}: Error finding container 4f3ef93ccf6698b86f58e71af8c4e1db098a5c8b93561ffede0c744e54a3212a: Status 404 returned error can't find the container with id 4f3ef93ccf6698b86f58e71af8c4e1db098a5c8b93561ffede0c744e54a3212a
Oct 30 23:35:39.035151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.035088    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:35:39.042878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.042600    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:35:39.130673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130582    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.130673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130644    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.130865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130694    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.130865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130743    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.130865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130804    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.130865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130828    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130872    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130924    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlxs\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.130955    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.131136    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.131342    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.131342    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.131400    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.131915 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.131897    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.133412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.133378    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.133632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.133544    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.190052 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.190014    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlxs\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.191968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.191939    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-clqt4\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.296189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.296152    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:39.345395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.345356    6126 generic.go:356] "Generic (PLEG): container finished" podID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerID="375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3" exitCode=0
Oct 30 23:35:39.345557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.345404    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"
Oct 30 23:35:39.345557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.345432    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerDied","Data":"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"}
Oct 30 23:35:39.345557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.345491    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" event={"ID":"ebef83cd-b6f7-4614-88d1-52949505d39c","Type":"ContainerDied","Data":"0de5e3b69fbe465ee7404f11b657acc583c0cd9e25ad7cce9a426964ba0991d3"}
Oct 30 23:35:39.345557 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.345523    6126 scope.go:122] "RemoveContainer" containerID="375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"
Oct 30 23:35:39.347493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.347469    6126 generic.go:356] "Generic (PLEG): container finished" podID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" containerID="044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634" exitCode=0
Oct 30 23:35:39.347670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.347609    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" event={"ID":"047a7acb-ecab-49ea-85ec-19ade8bf6a92","Type":"ContainerDied","Data":"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"}
Oct 30 23:35:39.347748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.347693    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd" event={"ID":"047a7acb-ecab-49ea-85ec-19ade8bf6a92","Type":"ContainerDied","Data":"b1925487b15c20271ba5fd483a4b7ad55425bb8616ec23324eb9eb4dece08349"}
Oct 30 23:35:39.347804 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.347769    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"
Oct 30 23:35:39.353819 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.353794    6126 generic.go:356] "Generic (PLEG): container finished" podID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" containerID="7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7" exitCode=0
Oct 30 23:35:39.353960 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.353941    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" event={"ID":"9ad00c7d-34c5-42d8-86f9-3aa430a75039","Type":"ContainerDied","Data":"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"}
Oct 30 23:35:39.354029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.353989    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn" event={"ID":"9ad00c7d-34c5-42d8-86f9-3aa430a75039","Type":"ContainerDied","Data":"80eec07df4cf845a23c80693d42ea37c44bfa18c73a16451cb4aef95cb3ca088"}
Oct 30 23:35:39.354100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.354060    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"
Oct 30 23:35:39.360004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.359780    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"
Oct 30 23:35:39.360004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.359802    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" event={"ID":"7ef657dd-653f-4443-891c-5f7fdb795d8a","Type":"ContainerDied","Data":"705f5c7be1f0b6ca9bf21c4cb37d61dee0248f3de6475d61e4c3feaa36e2bfc1"}
Oct 30 23:35:39.364710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.364689    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" event={"ID":"1f8d7623-86bf-4e6d-9edd-3ff62c13f398","Type":"ContainerStarted","Data":"4f3ef93ccf6698b86f58e71af8c4e1db098a5c8b93561ffede0c744e54a3212a"}
Oct 30 23:35:39.369354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.369331    6126 scope.go:122] "RemoveContainer" containerID="d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"
Oct 30 23:35:39.388698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.388672    6126 scope.go:122] "RemoveContainer" containerID="375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"
Oct 30 23:35:39.389179 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:39.389153    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3\": container with ID starting with 375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3 not found: ID does not exist" containerID="375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"
Oct 30 23:35:39.389332 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.389306    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3"} err="failed to get container status \"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3\": rpc error: code = NotFound desc = could not find container \"375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3\": container with ID starting with 375eee8eb91b953cd84f9fa354bea7fe3f9a227639fcac6a3e1c4dce90acaec3 not found: ID does not exist"
Oct 30 23:35:39.389431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.389421    6126 scope.go:122] "RemoveContainer" containerID="d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"
Oct 30 23:35:39.389859 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:39.389831    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473\": container with ID starting with d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473 not found: ID does not exist" containerID="d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"
Oct 30 23:35:39.389969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.389868    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473"} err="failed to get container status \"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473\": rpc error: code = NotFound desc = could not find container \"d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473\": container with ID starting with d9e3cbd6b48e1644f470e69e143ddfa47ed1e4bd4022d1d3347aecc6cf68f473 not found: ID does not exist"
Oct 30 23:35:39.389969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.389892    6126 scope.go:122] "RemoveContainer" containerID="044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"
Oct 30 23:35:39.411658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.411608    6126 scope.go:122] "RemoveContainer" containerID="044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"
Oct 30 23:35:39.412078 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:39.412057    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634\": container with ID starting with 044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634 not found: ID does not exist" containerID="044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"
Oct 30 23:35:39.412186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.412085    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634"} err="failed to get container status \"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634\": rpc error: code = NotFound desc = could not find container \"044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634\": container with ID starting with 044735879f1d529710020d015987560e256512e622b36aea2db5cf2dbb036634 not found: ID does not exist"
Oct 30 23:35:39.412186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.412102    6126 scope.go:122] "RemoveContainer" containerID="7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"
Oct 30 23:35:39.424894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.424876    6126 scope.go:122] "RemoveContainer" containerID="7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"
Oct 30 23:35:39.426213 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:35:39.425545    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7\": container with ID starting with 7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7 not found: ID does not exist" containerID="7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"
Oct 30 23:35:39.426213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.425581    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7"} err="failed to get container status \"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7\": rpc error: code = NotFound desc = could not find container \"7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7\": container with ID starting with 7d1cf764bdecdf6d3321a5d5f40ca41614ceb3d6e4a838e0a85f6dd959b856c7 not found: ID does not exist"
Oct 30 23:35:39.426213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.426135    6126 scope.go:122] "RemoveContainer" containerID="cc1eeae8967910c3bfbaadc78c326fc60c0a9ea29fbfb14bf079dda187942748"
Oct 30 23:35:39.514060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.514028    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:35:39.521933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.521901    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-j9lqd"]
Oct 30 23:35:39.595513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.595151    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:35:39.595513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.595220    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:35:39.639531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.639442    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:35:39.643568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.643540    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv"]
Oct 30 23:35:39.692598 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.692573    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:35:39.694392 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:39.694366    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3dca1ae_6cac_41ae_97a7_36b83aad481e.slice/crio-7f9f52160be8fd378a2f22f2fb712b60193d7270b40d0dfcc6c30fd8ad40c26e WatchSource:0}: Error finding container 7f9f52160be8fd378a2f22f2fb712b60193d7270b40d0dfcc6c30fd8ad40c26e: Status 404 returned error can't find the container with id 7f9f52160be8fd378a2f22f2fb712b60193d7270b40d0dfcc6c30fd8ad40c26e
Oct 30 23:35:39.697783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.697754    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:39.697901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.697821    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:39.697901 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.697867    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:39.753405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.753375    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:35:39.757574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.757552    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-jsqts"]
Oct 30 23:35:39.777497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.777472    6126 patch_prober.go:29] interesting pod/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:35:39.777648 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.777542    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-7xztv" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:35:39.867869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.867836    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:35:39.873373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:39.873342    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b81a7a-openshift-default-659d84594c-nxpmn"]
Oct 30 23:35:40.373707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.373676    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" event={"ID":"1f8d7623-86bf-4e6d-9edd-3ff62c13f398","Type":"ContainerStarted","Data":"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"}
Oct 30 23:35:40.373925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.373838    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:40.375317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.375294    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" event={"ID":"d3dca1ae-6cac-41ae-97a7-36b83aad481e","Type":"ContainerStarted","Data":"a6803118dec5896befbe879ed1d34e165905b2e6f6947b4a280a0c4dcff7b23e"}
Oct 30 23:35:40.375440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.375332    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" event={"ID":"d3dca1ae-6cac-41ae-97a7-36b83aad481e","Type":"ContainerStarted","Data":"7f9f52160be8fd378a2f22f2fb712b60193d7270b40d0dfcc6c30fd8ad40c26e"}
Oct 30 23:35:40.419328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.419287    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="047a7acb-ecab-49ea-85ec-19ade8bf6a92" path="/var/lib/kubelet/pods/047a7acb-ecab-49ea-85ec-19ade8bf6a92/volumes"
Oct 30 23:35:40.420120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.420097    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ef657dd-653f-4443-891c-5f7fdb795d8a" path="/var/lib/kubelet/pods/7ef657dd-653f-4443-891c-5f7fdb795d8a/volumes"
Oct 30 23:35:40.420813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.420783    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ad00c7d-34c5-42d8-86f9-3aa430a75039" path="/var/lib/kubelet/pods/9ad00c7d-34c5-42d8-86f9-3aa430a75039/volumes"
Oct 30 23:35:40.421944 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.421924    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" path="/var/lib/kubelet/pods/ebef83cd-b6f7-4614-88d1-52949505d39c/volumes"
Oct 30 23:35:40.670500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.670395    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" podStartSLOduration=2.806340582 podStartE2EDuration="3.669603785s" totalImagesPullingTime="863.263203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:40.511958353 +0000 UTC m=+1712.272050926" watchObservedRunningTime="2026-10-30 23:35:40.669603785 +0000 UTC m=+1712.429696360"
Oct 30 23:35:40.671414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:40.671365    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podStartSLOduration=2.67135515 podStartE2EDuration="2.67135515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:40.640142023 +0000 UTC m=+1712.400234595" watchObservedRunningTime="2026-10-30 23:35:40.67135515 +0000 UTC m=+1712.431447720"
Oct 30 23:35:41.302642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:41.302359    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:41.302642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:41.302569    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused" start-of-body=
Oct 30 23:35:41.302642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:41.302635    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused"
Oct 30 23:35:42.305138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:42.298317    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused" start-of-body=
Oct 30 23:35:42.305138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:42.298390    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused"
Oct 30 23:35:43.309604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:43.309239    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused" start-of-body=
Oct 30 23:35:43.309604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:43.309295    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused"
Oct 30 23:35:44.298642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:44.297989    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused" start-of-body=
Oct 30 23:35:44.298642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:44.298058    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused"
Oct 30 23:35:45.300706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:45.296964    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused" start-of-body=
Oct 30 23:35:45.300706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:45.297026    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.112:15021/healthz/ready\": dial tcp 10.134.0.112:15021: connect: connection refused"
Oct 30 23:35:46.306397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.306298    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:35:46.306938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.306912    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:35:46.409820 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.409786    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:46.410367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.410342    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:46.411291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.411271    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:35:46.420738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:46.420720    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:35:52.186522 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.186488    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:35:52.187716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.187691    6126 cpu_manager.go:414] "containerMap: removing container" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:52.187716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.187712    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebef83cd-b6f7-4614-88d1-52949505d39c" containerName="istio-proxy"
Oct 30 23:35:52.191502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.191484    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.246328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.246300    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w4-59d267-serving-cert\""
Oct 30 23:35:52.308898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.308674    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:35:52.366448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.366371    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg8h9\" (UniqueName: \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.366581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.366488    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.366581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.366552    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.366745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.366716    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.468737 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.468702    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.468915 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.468862    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg8h9\" (UniqueName: \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.468975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.468915    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.468975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.468964    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.469655 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.469575    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.471524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.471503    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.471600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.471532    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.527984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.527955    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg8h9\" (UniqueName: \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\") pod \"maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:52.809290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:52.809254    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:53.198892 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:53.198864    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:35:53.201425 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:35:53.201393    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd8cf0c_d3c3_40aa_8e79_5c269fc3e927.slice/crio-1a813dde4ccf02a92981c52529850bb8d56be677c59834c7f6511bab96bca07a WatchSource:0}: Error finding container 1a813dde4ccf02a92981c52529850bb8d56be677c59834c7f6511bab96bca07a: Status 404 returned error can't find the container with id 1a813dde4ccf02a92981c52529850bb8d56be677c59834c7f6511bab96bca07a
Oct 30 23:35:53.519121 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:53.519091    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" event={"ID":"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927","Type":"ContainerStarted","Data":"1a813dde4ccf02a92981c52529850bb8d56be677c59834c7f6511bab96bca07a"}
Oct 30 23:35:54.530520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:54.530483    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" event={"ID":"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927","Type":"ContainerStarted","Data":"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"}
Oct 30 23:35:54.531261 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:54.531232    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:35:54.651944 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:35:54.651895    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" podStartSLOduration=1.8159733089999999 podStartE2EDuration="2.651879651s" totalImagesPullingTime="835.906342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:54.650323755 +0000 UTC m=+1726.410416326" watchObservedRunningTime="2026-10-30 23:35:54.651879651 +0000 UTC m=+1726.411972226"
Oct 30 23:36:00.543869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:00.543839    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:36:03.164278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.164242    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:36:03.164718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.164442    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" containerID="cri-o://25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67" gracePeriod=30
Oct 30 23:36:03.214636 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.214582    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:36:03.214848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.214826    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy" containerID="cri-o://461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54" gracePeriod=30
Oct 30 23:36:03.217997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.217969    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:36:03.218183 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:03.218150    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy" containerID="cri-o://8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5" gracePeriod=30
Oct 30 23:36:04.152867 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:04.152819    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:36:07.456332 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:07.456291    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:36:07.456785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:07.456371    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:36:08.572308 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.572249    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:36:08.590505 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.590479    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:36:08.635873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.635846    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:36:08.654942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.654907    6126 generic.go:356] "Generic (PLEG): container finished" podID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerID="8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5" exitCode=0
Oct 30 23:36:08.655124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.654974    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"
Oct 30 23:36:08.655124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.654989    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" event={"ID":"bb80e4e5-6315-4d39-a24b-35e9c7091e33","Type":"ContainerDied","Data":"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"}
Oct 30 23:36:08.655124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.655063    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf" event={"ID":"bb80e4e5-6315-4d39-a24b-35e9c7091e33","Type":"ContainerDied","Data":"d5a1efb94c88ff4f1a49a4dc462feaf140474a3bf5035d10fcfceb32a65f400a"}
Oct 30 23:36:08.655124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.655087    6126 scope.go:122] "RemoveContainer" containerID="8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"
Oct 30 23:36:08.656304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.656282    6126 generic.go:356] "Generic (PLEG): container finished" podID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerID="461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54" exitCode=0
Oct 30 23:36:08.656422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.656307    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" event={"ID":"54b25369-0807-45c6-b8a0-4ae6feb8b74c","Type":"ContainerDied","Data":"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"}
Oct 30 23:36:08.656422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.656333    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"
Oct 30 23:36:08.656422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.656352    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h" event={"ID":"54b25369-0807-45c6-b8a0-4ae6feb8b74c","Type":"ContainerDied","Data":"62e36b18578cd4be7d3028942e6e31d408e3e81913e297552cd64174dd29e9ca"}
Oct 30 23:36:08.657850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.657832    6126 generic.go:356] "Generic (PLEG): container finished" podID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerID="25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67" exitCode=0
Oct 30 23:36:08.657953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.657879    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"
Oct 30 23:36:08.657953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.657889    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" event={"ID":"10601e56-1814-419b-bc3d-5b3cc11f76be","Type":"ContainerDied","Data":"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"}
Oct 30 23:36:08.657953 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.657917    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w" event={"ID":"10601e56-1814-419b-bc3d-5b3cc11f76be","Type":"ContainerDied","Data":"4ca7eb7d50395b25df4ed2d19f2f571c591721b375f38c0a56a3b0f93ea1fdc9"}
Oct 30 23:36:08.665689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.665670    6126 scope.go:122] "RemoveContainer" containerID="8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"
Oct 30 23:36:08.665972 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:08.665953    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5\": container with ID starting with 8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5 not found: ID does not exist" containerID="8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"
Oct 30 23:36:08.666021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.665980    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5"} err="failed to get container status \"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5\": rpc error: code = NotFound desc = could not find container \"8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5\": container with ID starting with 8b9f84eee05257a5ca0413a8a76712660ec573a18267e34d816c24081ac887f5 not found: ID does not exist"
Oct 30 23:36:08.666021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.665997    6126 scope.go:122] "RemoveContainer" containerID="461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"
Oct 30 23:36:08.676185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.676165    6126 scope.go:122] "RemoveContainer" containerID="461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"
Oct 30 23:36:08.676471 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:08.676453    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54\": container with ID starting with 461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54 not found: ID does not exist" containerID="461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"
Oct 30 23:36:08.676523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.676480    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54"} err="failed to get container status \"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54\": rpc error: code = NotFound desc = could not find container \"461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54\": container with ID starting with 461a6d73a842a02f3e0a1be195d684cf3388a947ea02bec1a1ad45eb1724ef54 not found: ID does not exist"
Oct 30 23:36:08.676523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.676497    6126 scope.go:122] "RemoveContainer" containerID="25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"
Oct 30 23:36:08.688185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.688166    6126 scope.go:122] "RemoveContainer" containerID="25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"
Oct 30 23:36:08.688473 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:08.688449    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67\": container with ID starting with 25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67 not found: ID does not exist" containerID="25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"
Oct 30 23:36:08.688539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.688484    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67"} err="failed to get container status \"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67\": rpc error: code = NotFound desc = could not find container \"25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67\": container with ID starting with 25a44624c0103b2be427cc41d0cbfcef6d0abe18e7f78b3728afe00f48512e67 not found: ID does not exist"
Oct 30 23:36:08.734794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734759    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.734975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734812    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.734975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734848    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.734975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734876    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.734975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734941    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.734975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734971    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.735230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.734998    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.735230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735057    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.735230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735098    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.735230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735139    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.735230 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735194    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.735491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735442    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.735491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735467    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735588    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735697    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735711    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735773    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735847    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735882    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.735958    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736139    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736189    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736251    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736296    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\") pod \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\" (UID: \"bb80e4e5-6315-4d39-a24b-35e9c7091e33\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736343    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736384    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736387    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736435    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736495    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736522    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736559    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736607    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\") pod \"10601e56-1814-419b-bc3d-5b3cc11f76be\" (UID: \"10601e56-1814-419b-bc3d-5b3cc11f76be\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736655    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736670    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\") pod \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\" (UID: \"54b25369-0807-45c6-b8a0-4ae6feb8b74c\") "
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.736840    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737013    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737366    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737657    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.737688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737654    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737761    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737923    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.737996    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738064    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738082    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738117    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738132    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738148    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10601e56-1814-419b-bc3d-5b3cc11f76be-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738164    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738178    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738191    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738204    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.738219    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739183    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:36:08.739211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739201    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "kube-api-access-qdd46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.739989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739238    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "kube-api-access-hpxs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.739989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739529    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.739989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739556    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "kube-api-access-8s5k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.739989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739720    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.739989 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.739794    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.740175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.740086    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.740341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.740317    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo" pod "54b25369-0807-45c6-b8a0-4ae6feb8b74c" (UID: "54b25369-0807-45c6-b8a0-4ae6feb8b74c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:36:08.740839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.740823    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:36:08.741030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.741013    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token" pod "10601e56-1814-419b-bc3d-5b3cc11f76be" (UID: "10601e56-1814-419b-bc3d-5b3cc11f76be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:08.741217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.741202    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo" pod "bb80e4e5-6315-4d39-a24b-35e9c7091e33" (UID: "bb80e4e5-6315-4d39-a24b-35e9c7091e33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839720    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839747    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839757    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839766    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839775    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839783    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839792    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839800    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s5k7\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-kube-api-access-8s5k7\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839809    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.839812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839818    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxs7\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-kube-api-access-hpxs7\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839826    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b25369-0807-45c6-b8a0-4ae6feb8b74c-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839835    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdd46\" (UniqueName: \"kubernetes.io/projected/bb80e4e5-6315-4d39-a24b-35e9c7091e33-kube-api-access-qdd46\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839843    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839852    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10601e56-1814-419b-bc3d-5b3cc11f76be-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839861    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839869    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb80e4e5-6315-4d39-a24b-35e9c7091e33-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:08.840449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:08.839878    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10601e56-1814-419b-bc3d-5b3cc11f76be-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:36:09.168018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.167935    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:36:09.171130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.171107    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8d84w"]
Oct 30 23:36:09.278481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.278447    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:36:09.284724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.284365    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-p6j5h"]
Oct 30 23:36:09.393914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.393876    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:36:09.400386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:09.400355    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-7d9vf"]
Oct 30 23:36:10.408750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:10.408719    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" path="/var/lib/kubelet/pods/10601e56-1814-419b-bc3d-5b3cc11f76be/volumes"
Oct 30 23:36:10.409282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:10.409266    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" path="/var/lib/kubelet/pods/54b25369-0807-45c6-b8a0-4ae6feb8b74c/volumes"
Oct 30 23:36:10.409774 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:10.409759    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" path="/var/lib/kubelet/pods/bb80e4e5-6315-4d39-a24b-35e9c7091e33/volumes"
Oct 30 23:36:26.811328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.811282    6126 generic.go:356] "Generic (PLEG): container finished" podID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerID="a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9" exitCode=0
Oct 30 23:36:26.811892 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.811353    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerDied","Data":"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"}
Oct 30 23:36:26.811977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.811894    6126 scope.go:122] "RemoveContainer" containerID="a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"
Oct 30 23:36:26.813750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.813724    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:26.813874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.813790    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:26.813874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:26.813820    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:27.821788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:27.821744    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerStarted","Data":"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"}
Oct 30 23:36:28.587003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:28.586971    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:36:28.587347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:28.587325    6126 patch_prober.go:29] interesting pod/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:36:28.587521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:28.587496    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 23:36:29.603923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:29.603885    6126 patch_prober.go:29] interesting pod/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:36:29.604603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:29.604566    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 23:36:30.600642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:30.584674    6126 patch_prober.go:29] interesting pod/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:36:30.600642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:30.584732    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 23:36:31.475291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.475251    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:36:31.476236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476212    6126 cpu_manager.go:414] "containerMap: removing container" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy"
Oct 30 23:36:31.476353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476238    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy"
Oct 30 23:36:31.476353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476253    6126 cpu_manager.go:414] "containerMap: removing container" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy"
Oct 30 23:36:31.476353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476259    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy"
Oct 30 23:36:31.476353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476303    6126 cpu_manager.go:414] "containerMap: removing container" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy"
Oct 30 23:36:31.476353 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476311    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy"
Oct 30 23:36:31.476601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476511    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="54b25369-0807-45c6-b8a0-4ae6feb8b74c" containerName="istio-proxy"
Oct 30 23:36:31.476601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476528    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="10601e56-1814-419b-bc3d-5b3cc11f76be" containerName="istio-proxy"
Oct 30 23:36:31.476601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.476544    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb80e4e5-6315-4d39-a24b-35e9c7091e33" containerName="istio-proxy"
Oct 30 23:36:31.493920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.493890    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.540561 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.540530    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:36:31.545747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.545717    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hplq\" (UniqueName: \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.545936 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.545908    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.546023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.545993    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.546089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.546070    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.612076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.608553    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-557e9b-serving-cert\""
Oct 30 23:36:31.613043 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.613016    6126 patch_prober.go:29] interesting pod/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:36:31.613740 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.613700    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 23:36:31.647977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.647940    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hplq\" (UniqueName: \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.648134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.648107    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.648192 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.648177    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.648264 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:31.648243    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-serving-cert: secret "maas-api-e2e-shared-a-w3-557e9b-serving-cert" not found
Oct 30 23:36:31.648301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.648259    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.648335 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:31.648312    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls podName:df16f1ae-c582-4244-ad33-06e621610839 nodeName:}" failed. No retries permitted until 2026-10-30 23:36:32.148295478 +0000 UTC m=+1763.908388027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls") pod "maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" (UID: "df16f1ae-c582-4244-ad33-06e621610839") : secret "maas-api-e2e-shared-a-w3-557e9b-serving-cert" not found
Oct 30 23:36:31.648803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.648784    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.650815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.650796    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:31.729081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:31.728596    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hplq\" (UniqueName: \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:32.155944 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.155860    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:32.158478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.158456    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:32.419435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.419349    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:32.607811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.607285    6126 patch_prober.go:29] interesting pod/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:36:32.607811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.607345    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 23:36:32.809358 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.809324    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:36:32.809766 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:36:32.809719    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf16f1ae_c582_4244_ad33_06e621610839.slice/crio-09a9b02069d06836d6d47ae0c58d003943b2d269fd62b4c31ff9e041a44249c9 WatchSource:0}: Error finding container 09a9b02069d06836d6d47ae0c58d003943b2d269fd62b4c31ff9e041a44249c9: Status 404 returned error can't find the container with id 09a9b02069d06836d6d47ae0c58d003943b2d269fd62b4c31ff9e041a44249c9
Oct 30 23:36:32.860105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:32.860071    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" event={"ID":"df16f1ae-c582-4244-ad33-06e621610839","Type":"ContainerStarted","Data":"09a9b02069d06836d6d47ae0c58d003943b2d269fd62b4c31ff9e041a44249c9"}
Oct 30 23:36:33.589995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.589963    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:36:33.590395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.590373    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:36:33.591305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.591282    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:36:33.869561 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.869472    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" event={"ID":"df16f1ae-c582-4244-ad33-06e621610839","Type":"ContainerStarted","Data":"32b4e5828b553cd93ea727d694e37f20a097aa3f566e19e5e0507fcb4fad2c1a"}
Oct 30 23:36:33.870133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.870107    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:33.995873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:33.995810    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" podStartSLOduration=2.153038932 podStartE2EDuration="2.995796564s" totalImagesPullingTime="842.757632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:33.994395467 +0000 UTC m=+1765.754488040" watchObservedRunningTime="2026-10-30 23:36:33.995796564 +0000 UTC m=+1765.755889134"
Oct 30 23:36:34.163051 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:36:34.162962    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:36:39.888832 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:39.888799    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:36:55.994274 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:55.994231    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:36:55.999432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:55.999405    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.052928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.052898    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ba13e7-openshift-default-dockercfg-dr5sv\""
Oct 30 23:36:56.089377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089329    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.089573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089390    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kmzv\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.089672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089641    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.089733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089700    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.089807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089793    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.089930 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.089901    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.090016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.090000    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.090079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.090064    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.090135 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.090121    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.128184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.128138    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191552    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191631    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191696    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191748    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191820    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191883    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191925    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191956    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.191990    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kmzv\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.192027    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.192946 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.192310    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.193014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.192973    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.193662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.193509    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.204585 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.196064    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.205135 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.205108    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.207102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.207076    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.260896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.259512    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.267669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.262085    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kmzv\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\") pod \"e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") " pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.323383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.323350    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:56.798670 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:36:56.798594    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd00655_86c3_4e24_abe2_e35063a95bfb.slice/crio-4f9607f41159ce5c48cf76f9616bd262b39287731e19446051b2ff98a35f2320 WatchSource:0}: Error finding container 4f9607f41159ce5c48cf76f9616bd262b39287731e19446051b2ff98a35f2320: Status 404 returned error can't find the container with id 4f9607f41159ce5c48cf76f9616bd262b39287731e19446051b2ff98a35f2320
Oct 30 23:36:56.799440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.799415    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:36:56.801588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.801553    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:56.802029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.802008    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:56.802075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:56.802059    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:57.166815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.166721    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerStarted","Data":"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"}
Oct 30 23:36:57.166815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.166784    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerStarted","Data":"4f9607f41159ce5c48cf76f9616bd262b39287731e19446051b2ff98a35f2320"}
Oct 30 23:36:57.237773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.237729    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:36:57.237955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.237792    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:36:57.309016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.308955    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podStartSLOduration=2.308934891 podStartE2EDuration="2.308934891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:57.305690975 +0000 UTC m=+1789.065783546" watchObservedRunningTime="2026-10-30 23:36:57.308934891 +0000 UTC m=+1789.069027464"
Oct 30 23:36:57.323867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.323823    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:57.325866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.325837    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:36:57.325994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:57.325890    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:36:58.331518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:58.331484    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:59.152420 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.152328    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:36:59.156464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.156442    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.183977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.183893    6126 generic.go:356] "Generic (PLEG): container finished" podID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerID="da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38" exitCode=0
Oct 30 23:36:59.184816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.184167    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerDied","Data":"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"}
Oct 30 23:36:59.185426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.184988    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:59.185426 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.184998    6126 scope.go:122] "RemoveContainer" containerID="da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"
Oct 30 23:36:59.190590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.187594    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:59.190590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.187700    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:59.190590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.187756    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:36:59.190590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.189451    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:36:59.215031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.214994    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w6-3be34b\""
Oct 30 23:36:59.217548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.217521    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w6-3be34b-dockercfg-pwjpd\""
Oct 30 23:36:59.262770 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.262671    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:36:59.271669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.268106    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pfbs\" (UniqueName: \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.271669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.268185    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.293976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.293952    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:36:59.300451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.300425    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.360838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.359163    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:36:59.372196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.370598    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.372196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.370758    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4f54\" (UniqueName: \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.372196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.370857    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pfbs\" (UniqueName: \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.372196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.370900    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.372196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.371844    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.456456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.456328    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pfbs\" (UniqueName: \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\") pod \"payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.479639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.478164    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.479639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.478297    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4f54\" (UniqueName: \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.479639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.478824    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:36:59.486643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.481269    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.560505 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.560426    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4f54\" (UniqueName: \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\") pod \"payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:36:59.736729 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:36:59.683705    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:37:00.007303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.007203    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:37:00.020001 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:00.019955    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f85f95_17f2_40c7_86e4_35267308c14a.slice/crio-108de051ac58c820cfc232a02f68ce8719833925defc6ded732e7ad24358294b WatchSource:0}: Error finding container 108de051ac58c820cfc232a02f68ce8719833925defc6ded732e7ad24358294b: Status 404 returned error can't find the container with id 108de051ac58c820cfc232a02f68ce8719833925defc6ded732e7ad24358294b
Oct 30 23:37:00.161286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.161258    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:37:00.162803 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:00.162771    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf790bb6f_2b36_4429_b521_899f9327de51.slice/crio-dd77dcbcd82d76bad1f8a8bc6e3c51c757a1b4ce9f4a40184ec13fb3fecfaa97 WatchSource:0}: Error finding container dd77dcbcd82d76bad1f8a8bc6e3c51c757a1b4ce9f4a40184ec13fb3fecfaa97: Status 404 returned error can't find the container with id dd77dcbcd82d76bad1f8a8bc6e3c51c757a1b4ce9f4a40184ec13fb3fecfaa97
Oct 30 23:37:00.211924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.211262    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" event={"ID":"a6f85f95-17f2-40c7-86e4-35267308c14a","Type":"ContainerStarted","Data":"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"}
Oct 30 23:37:00.211924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.211326    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" event={"ID":"a6f85f95-17f2-40c7-86e4-35267308c14a","Type":"ContainerStarted","Data":"108de051ac58c820cfc232a02f68ce8719833925defc6ded732e7ad24358294b"}
Oct 30 23:37:00.211924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.211889    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:37:00.214040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.214012    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerStarted","Data":"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"}
Oct 30 23:37:00.215908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.215884    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" event={"ID":"f790bb6f-2b36-4429-b521-899f9327de51","Type":"ContainerStarted","Data":"dd77dcbcd82d76bad1f8a8bc6e3c51c757a1b4ce9f4a40184ec13fb3fecfaa97"}
Oct 30 23:37:00.329605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.329546    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" podStartSLOduration=1.329530823 podStartE2EDuration="1.329530823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:00.325962618 +0000 UTC m=+1792.086055191" watchObservedRunningTime="2026-10-30 23:37:00.329530823 +0000 UTC m=+1792.089623407"
Oct 30 23:37:00.349250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.349213    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:37:00.349438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.349390    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:00.349518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:00.349477    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:01.242908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:01.241047    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" event={"ID":"f790bb6f-2b36-4429-b521-899f9327de51","Type":"ContainerStarted","Data":"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"}
Oct 30 23:37:01.244458 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:01.244425    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:37:01.349549 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:01.349520    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:01.349732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:01.349572    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:02.349629 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:02.349575    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:02.350138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:02.349649    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:03.349430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:03.349394    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:03.349667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:03.349473    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:04.153197 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:37:04.153154    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:37:04.349974 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:04.349930    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:04.350578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:04.349991    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:05.353156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:05.353119    6126 patch_prober.go:29] interesting pod/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Oct 30 23:37:05.353775 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:05.353203    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Oct 30 23:37:06.353899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:06.353868    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:37:06.354392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:06.354273    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:37:06.355019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:06.354997    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:37:06.523985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:06.523927    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" podStartSLOduration=7.5239134530000005 podStartE2EDuration="7.523913453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:01.385867701 +0000 UTC m=+1793.145960273" watchObservedRunningTime="2026-10-30 23:37:06.523913453 +0000 UTC m=+1798.284006050"
Oct 30 23:37:08.762281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:08.762250    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:37:08.772193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:08.772164    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:37:09.023026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.022936    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:37:09.027845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.027820    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.080796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.080760    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ba13e7-dockercfg-xjlvh\""
Oct 30 23:37:09.116711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.116409    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.116711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.116683    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8wn\" (UniqueName: \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.142969 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.142933    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ba13e7\""
Oct 30 23:37:09.152754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.152721    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:37:09.199509 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.199477    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:37:09.204351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.204325    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.217827 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.217792    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8vh\" (UniqueName: \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.218023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.217912    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.218093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.218059    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.218151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.218123    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8wn\" (UniqueName: \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.219371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.219342    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.241373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.241337    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:37:09.312129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.312038    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8wn\" (UniqueName: \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\") pod \"payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.321023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.320984    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8vh\" (UniqueName: \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.321277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.321253    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.322142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.322118    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.347226 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.347200    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:09.379828 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.379802    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8vh\" (UniqueName: \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\") pod \"payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") " pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.529201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.529154    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:09.751907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.751872    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:37:09.753328 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:09.753303    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e301a2_c297_45ae_a892_2d610b58cb93.slice/crio-57c0e3afae31962661ae75a539fa1e821476a0433a5e5ce67956df9176229608 WatchSource:0}: Error finding container 57c0e3afae31962661ae75a539fa1e821476a0433a5e5ce67956df9176229608: Status 404 returned error can't find the container with id 57c0e3afae31962661ae75a539fa1e821476a0433a5e5ce67956df9176229608
Oct 30 23:37:09.933040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:09.933015    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:37:09.934402 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:09.934370    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce14eb2_2b79_4337_8bbe_2ab0b5cca437.slice/crio-4c059b02be4c3439e6a8368d889f00a5d13fac726a00e646ac2d9566f181fb9a WatchSource:0}: Error finding container 4c059b02be4c3439e6a8368d889f00a5d13fac726a00e646ac2d9566f181fb9a: Status 404 returned error can't find the container with id 4c059b02be4c3439e6a8368d889f00a5d13fac726a00e646ac2d9566f181fb9a
Oct 30 23:37:10.395822 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.395779    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" event={"ID":"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437","Type":"ContainerStarted","Data":"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"}
Oct 30 23:37:10.396017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.395842    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" event={"ID":"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437","Type":"ContainerStarted","Data":"4c059b02be4c3439e6a8368d889f00a5d13fac726a00e646ac2d9566f181fb9a"}
Oct 30 23:37:10.396017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.395991    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:10.397524 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.397500    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" event={"ID":"b1e301a2-c297-45ae-a892-2d610b58cb93","Type":"ContainerStarted","Data":"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"}
Oct 30 23:37:10.397712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.397541    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" event={"ID":"b1e301a2-c297-45ae-a892-2d610b58cb93","Type":"ContainerStarted","Data":"57c0e3afae31962661ae75a539fa1e821476a0433a5e5ce67956df9176229608"}
Oct 30 23:37:10.397712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.397574    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:10.511356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.511306    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" podStartSLOduration=1.511292232 podStartE2EDuration="1.511292232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:10.510118809 +0000 UTC m=+1802.270211381" watchObservedRunningTime="2026-10-30 23:37:10.511292232 +0000 UTC m=+1802.271384849"
Oct 30 23:37:10.638467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:10.638412    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" podStartSLOduration=2.638393705 podStartE2EDuration="2.638393705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:10.632535286 +0000 UTC m=+1802.392627858" watchObservedRunningTime="2026-10-30 23:37:10.638393705 +0000 UTC m=+1802.398486275"
Oct 30 23:37:11.247071 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:11.247042    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:37:12.261272 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:12.261246    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:37:13.920349 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:13.920311    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:37:13.925602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:13.925575    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:13.995349 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:13.995312    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:13.995663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:13.995632    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxqx\" (UniqueName: \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.002026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.001983    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:37:14.050641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.050222    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bcc619\""
Oct 30 23:37:14.050641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.050363    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bcc619-dockercfg-hdc7s\""
Oct 30 23:37:14.057079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.052963    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:37:14.058229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.058205    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.122471    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.122579    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gkwm\" (UniqueName: \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.122738    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.122770    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxqx\" (UniqueName: \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.123697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.139676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.139559    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:37:14.209320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.207819    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxqx\" (UniqueName: \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\") pod \"payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.223968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.223930    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gkwm\" (UniqueName: \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.224211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.224192    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.225144 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.225121    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.246378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.245104    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:14.284800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.284738    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gkwm\" (UniqueName: \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\") pod \"payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") " pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.379940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.379900    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:14.649371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.649340    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:37:14.650127 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:14.650098    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cc25df_9a3e_4e27_a23b_48e586e99269.slice/crio-801b53a92a455c90e3a8081dedf43523b4f90bd1e51e17cca68fe0f4355894d7 WatchSource:0}: Error finding container 801b53a92a455c90e3a8081dedf43523b4f90bd1e51e17cca68fe0f4355894d7: Status 404 returned error can't find the container with id 801b53a92a455c90e3a8081dedf43523b4f90bd1e51e17cca68fe0f4355894d7
Oct 30 23:37:14.787626 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:14.787583    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cbeeb7_f070_47b5_b56f_4e53e6c01a74.slice/crio-c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06 WatchSource:0}: Error finding container c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06: Status 404 returned error can't find the container with id c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06
Oct 30 23:37:14.787772 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:14.787723    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:37:15.453553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.453509    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" event={"ID":"33cc25df-9a3e-4e27-a23b-48e586e99269","Type":"ContainerStarted","Data":"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"}
Oct 30 23:37:15.454022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.453574    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" event={"ID":"33cc25df-9a3e-4e27-a23b-48e586e99269","Type":"ContainerStarted","Data":"801b53a92a455c90e3a8081dedf43523b4f90bd1e51e17cca68fe0f4355894d7"}
Oct 30 23:37:15.454022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.453597    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:15.455388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.455355    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" event={"ID":"18cbeeb7-f070-47b5-b56f-4e53e6c01a74","Type":"ContainerStarted","Data":"a6d0a17a8154a009e83e5e1c49b694a68bf667bda4cbb2e6ede0a7f446662209"}
Oct 30 23:37:15.455515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.455401    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" event={"ID":"18cbeeb7-f070-47b5-b56f-4e53e6c01a74","Type":"ContainerStarted","Data":"c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06"}
Oct 30 23:37:15.455515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.455440    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:15.572081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.572022    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" podStartSLOduration=2.572007388 podStartE2EDuration="2.572007388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:15.568973064 +0000 UTC m=+1807.329065642" watchObservedRunningTime="2026-10-30 23:37:15.572007388 +0000 UTC m=+1807.332099959"
Oct 30 23:37:15.688291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:15.688228    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" podStartSLOduration=2.688207918 podStartE2EDuration="2.688207918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:15.684871322 +0000 UTC m=+1807.444963921" watchObservedRunningTime="2026-10-30 23:37:15.688207918 +0000 UTC m=+1807.448300491"
Oct 30 23:37:21.409075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:21.409045    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:37:21.409602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:21.409471    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:37:26.466344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:26.466316    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:37:26.466947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:26.466394    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:37:34.156804 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:37:34.156764    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:37:38.728244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.728206    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:37:38.733331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.733303    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.787125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.786345    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-b526ac\""
Oct 30 23:37:38.787125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.787080    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-b526ac-dockercfg-r9nnr\""
Oct 30 23:37:38.790970 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.790938    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:37:38.821777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.821481    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpjd\" (UniqueName: \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.821777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.821532    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.875163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.875126    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:37:38.879997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.879970    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:38.922629 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.922580    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdg98\" (UniqueName: \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:38.922819 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.922698    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:38.922919 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.922893    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpjd\" (UniqueName: \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.922984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.922966    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.923628 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.923595    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:38.939424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.939390    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:37:38.982080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:38.982011    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpjd\" (UniqueName: \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\") pod \"payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:39.024777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.024741    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:39.025219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.025008    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdg98\" (UniqueName: \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:39.025605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.025586    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:39.051440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.051402    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:39.092324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.092286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdg98\" (UniqueName: \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\") pod \"payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:39.201031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.200997    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:39.467283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.467252    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:37:39.467949 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:37:39.467925    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b14ccbd_0d9f_474b_8e57_dd640c6d6db4.slice/crio-508885cbff0548fd0e534fb14d226b72834e87c919dcb1d4f85edfb26546b99c WatchSource:0}: Error finding container 508885cbff0548fd0e534fb14d226b72834e87c919dcb1d4f85edfb26546b99c: Status 404 returned error can't find the container with id 508885cbff0548fd0e534fb14d226b72834e87c919dcb1d4f85edfb26546b99c
Oct 30 23:37:39.644820 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.644772    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" event={"ID":"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4","Type":"ContainerStarted","Data":"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"}
Oct 30 23:37:39.644992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.644838    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" event={"ID":"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4","Type":"ContainerStarted","Data":"508885cbff0548fd0e534fb14d226b72834e87c919dcb1d4f85edfb26546b99c"}
Oct 30 23:37:39.644992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.644865    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:39.688288 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.688261    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:37:39.764563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:39.764514    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" podStartSLOduration=1.76449976 podStartE2EDuration="1.76449976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:39.761690338 +0000 UTC m=+1831.521782924" watchObservedRunningTime="2026-10-30 23:37:39.76449976 +0000 UTC m=+1831.524592361"
Oct 30 23:37:40.655254 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:40.655210    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" event={"ID":"792a848c-f121-451d-9c8d-ddeae39fc71a","Type":"ContainerStarted","Data":"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"}
Oct 30 23:37:40.655486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:40.655284    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" event={"ID":"792a848c-f121-451d-9c8d-ddeae39fc71a","Type":"ContainerStarted","Data":"a60f7f1122d77529af21bf155d8acede58817c9641a059af7d9b96fffddb5a10"}
Oct 30 23:37:40.655533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:40.655508    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:37:40.773340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:40.773290    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" podStartSLOduration=2.773275497 podStartE2EDuration="2.773275497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:40.770050122 +0000 UTC m=+1832.530142694" watchObservedRunningTime="2026-10-30 23:37:40.773275497 +0000 UTC m=+1832.533368067"
Oct 30 23:37:50.659489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:50.659455    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:37:51.667132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:37:51.667105    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:38:01.072291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.066970    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:38:01.076799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.076766    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.091698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.080263    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:38:01.107733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.107679    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.108213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.108183    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7m8\" (UniqueName: \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.208644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.201285    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7a42d8\""
Oct 30 23:38:01.208644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.201366    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7a42d8-dockercfg-j8wmk\""
Oct 30 23:38:01.212645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.210992    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7m8\" (UniqueName: \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.212645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.211200    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.212645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.212204    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.217282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.217251    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:38:01.223425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.223399    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.257562 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.257523    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:38:01.276155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.276119    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7m8\" (UniqueName: \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\") pod \"payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.399325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.399227    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:01.413961 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.413930    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.414594 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.414204    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7n5t\" (UniqueName: \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.516315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.516256    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.516513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.516454    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7n5t\" (UniqueName: \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.517324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.517012    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.575430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.575392    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7n5t\" (UniqueName: \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\") pod \"payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:01.787691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.787660    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:38:01.788080 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:38:01.788057    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ceeecd_8be8_4f89_a956_befef0c2b31d.slice/crio-8624033d61bb34180840eef0c63f57ef084cb170dfc4a418b01b22cc71ed7127 WatchSource:0}: Error finding container 8624033d61bb34180840eef0c63f57ef084cb170dfc4a418b01b22cc71ed7127: Status 404 returned error can't find the container with id 8624033d61bb34180840eef0c63f57ef084cb170dfc4a418b01b22cc71ed7127
Oct 30 23:38:01.837986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.837952    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" event={"ID":"e6ceeecd-8be8-4f89-a956-befef0c2b31d","Type":"ContainerStarted","Data":"8624033d61bb34180840eef0c63f57ef084cb170dfc4a418b01b22cc71ed7127"}
Oct 30 23:38:01.847955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:01.847930    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:02.234814 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.234786    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:38:02.235604 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:38:02.235573    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e95bf1_07b1_4fd7_990c_6a390da6e4e1.slice/crio-44ccb856b3608983f155996d8a9cc5dbe2d77fbf731696630d33c6eb90d01731 WatchSource:0}: Error finding container 44ccb856b3608983f155996d8a9cc5dbe2d77fbf731696630d33c6eb90d01731: Status 404 returned error can't find the container with id 44ccb856b3608983f155996d8a9cc5dbe2d77fbf731696630d33c6eb90d01731
Oct 30 23:38:02.848311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.848275    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" event={"ID":"22e95bf1-07b1-4fd7-990c-6a390da6e4e1","Type":"ContainerStarted","Data":"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"}
Oct 30 23:38:02.848519 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.848334    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" event={"ID":"22e95bf1-07b1-4fd7-990c-6a390da6e4e1","Type":"ContainerStarted","Data":"44ccb856b3608983f155996d8a9cc5dbe2d77fbf731696630d33c6eb90d01731"}
Oct 30 23:38:02.848519 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.848368    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:02.850236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.850202    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" event={"ID":"e6ceeecd-8be8-4f89-a956-befef0c2b31d","Type":"ContainerStarted","Data":"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"}
Oct 30 23:38:02.850356 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.850263    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:02.968219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:02.968165    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" podStartSLOduration=1.968151535 podStartE2EDuration="1.968151535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:02.965716561 +0000 UTC m=+1854.725809135" watchObservedRunningTime="2026-10-30 23:38:02.968151535 +0000 UTC m=+1854.728244105"
Oct 30 23:38:03.110692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.093202    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" podStartSLOduration=3.093172718 podStartE2EDuration="3.093172718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:03.092357313 +0000 UTC m=+1854.852449885" watchObservedRunningTime="2026-10-30 23:38:03.093172718 +0000 UTC m=+1854.853265290"
Oct 30 23:38:03.774927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.774888    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:38:03.775438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.775142    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" containerID="cri-o://38b14f4d307181554ad904ce2fd12cf9ee31298f65378719bbbc9415538b3a24" gracePeriod=30
Oct 30 23:38:03.849678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.849646    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:38:03.854788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.854761    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:03.907404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.907370    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w6-3be34b-serving-cert\""
Oct 30 23:38:03.909502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.909475    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:38:03.966581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.966538    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264wv\" (UniqueName: \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:03.966823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.966804    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:03.966922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.966899    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:03.967101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:03.967084    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.068149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.068057    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.068328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.068157    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.068328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.068190    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.068328 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:38:04.068225    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-serving-cert: secret "maas-api-e2e-shared-b-w6-3be34b-serving-cert" not found
Oct 30 23:38:04.068486 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:38:04.068330    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls podName:45625647-4456-4f40-b907-95ee1e9b5615 nodeName:}" failed. No retries permitted until 2026-10-30 23:38:04.568301167 +0000 UTC m=+1856.328393719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls") pod "maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" (UID: "45625647-4456-4f40-b907-95ee1e9b5615") : secret "maas-api-e2e-shared-b-w6-3be34b-serving-cert" not found
Oct 30 23:38:04.079508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.068454    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264wv\" (UniqueName: \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.079508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.069204    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.079508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.071741    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.146117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.146013    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-264wv\" (UniqueName: \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.211284 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:38:04.211240    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:38:04.577239 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.577205    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.579719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.579697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:04.770575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:04.770399    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:05.168204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:05.168178    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:38:05.168567 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:38:05.168543    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45625647_4456_4f40_b907_95ee1e9b5615.slice/crio-bf2ec8f93f6525a33921a8c2ca01e68d374ae8a2978247f6778cf7e1078e7757 WatchSource:0}: Error finding container bf2ec8f93f6525a33921a8c2ca01e68d374ae8a2978247f6778cf7e1078e7757: Status 404 returned error can't find the container with id bf2ec8f93f6525a33921a8c2ca01e68d374ae8a2978247f6778cf7e1078e7757
Oct 30 23:38:05.878882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:05.878848    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" event={"ID":"45625647-4456-4f40-b907-95ee1e9b5615","Type":"ContainerStarted","Data":"bf2ec8f93f6525a33921a8c2ca01e68d374ae8a2978247f6778cf7e1078e7757"}
Oct 30 23:38:06.891555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:06.891518    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" event={"ID":"45625647-4456-4f40-b907-95ee1e9b5615","Type":"ContainerStarted","Data":"1bcac0b29e96ac7b574f4317eccd9284bae1fba1dd3b227ca12d6b2173754143"}
Oct 30 23:38:06.892204 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:06.891600    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:07.013595 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:07.013518    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" podStartSLOduration=3.196350647 podStartE2EDuration="4.013501026s" totalImagesPullingTime="817.150379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:07.007430067 +0000 UTC m=+1858.767522675" watchObservedRunningTime="2026-10-30 23:38:07.013501026 +0000 UTC m=+1858.773593597"
Oct 30 23:38:08.203449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:08.203409    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:38:08.203986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:08.203475    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:38:08.911260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:08.911227    6126 generic.go:356] "Generic (PLEG): container finished" podID="d375ce5c-2079-4d10-b676-65ff5415257c" containerID="38b14f4d307181554ad904ce2fd12cf9ee31298f65378719bbbc9415538b3a24" exitCode=0
Oct 30 23:38:08.911449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:08.911314    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" event={"ID":"d375ce5c-2079-4d10-b676-65ff5415257c","Type":"ContainerDied","Data":"38b14f4d307181554ad904ce2fd12cf9ee31298f65378719bbbc9415538b3a24"}
Oct 30 23:38:09.112456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.112427    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:38:09.253672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253592    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253716    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253741    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253765    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253878    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253894    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253974    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.253984    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254049    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254078    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254117    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\") pod \"d375ce5c-2079-4d10-b676-65ff5415257c\" (UID: \"d375ce5c-2079-4d10-b676-65ff5415257c\") "
Oct 30 23:38:09.254795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254347    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:38:09.254795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254497    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:38:09.254795 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.254525    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:38:09.255181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.255158    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.255259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.255187    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d375ce5c-2079-4d10-b676-65ff5415257c-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.255259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.255202    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.255259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.255219    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.255259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.255233    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.256227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.256203    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:38:09.256362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.256253    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:38:09.256441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.256365    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "kube-api-access-xwrsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:38:09.256501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.256452    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy" pod "d375ce5c-2079-4d10-b676-65ff5415257c" (UID: "d375ce5c-2079-4d10-b676-65ff5415257c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:38:09.356743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.356609    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d375ce5c-2079-4d10-b676-65ff5415257c-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.356743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.356670    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwrsn\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-kube-api-access-xwrsn\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.356743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.356686    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d375ce5c-2079-4d10-b676-65ff5415257c-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.356743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.356701    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d375ce5c-2079-4d10-b676-65ff5415257c-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:38:09.922592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.922559    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"
Oct 30 23:38:09.922592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.922590    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4" event={"ID":"d375ce5c-2079-4d10-b676-65ff5415257c","Type":"ContainerDied","Data":"ecd7744350858548b887a297c12f2f0de990d121475c7a5d55fe11a21cce0bca"}
Oct 30 23:38:09.922896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:09.922671    6126 scope.go:122] "RemoveContainer" containerID="38b14f4d307181554ad904ce2fd12cf9ee31298f65378719bbbc9415538b3a24"
Oct 30 23:38:10.092268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:10.092227    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:38:10.096525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:10.096494    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-9w4p4"]
Oct 30 23:38:10.410829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:10.410795    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" path="/var/lib/kubelet/pods/d375ce5c-2079-4d10-b676-65ff5415257c/volumes"
Oct 30 23:38:12.905831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:12.905802    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:38:13.864223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:13.864193    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:38:13.864424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:38:13.864272    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:38:34.153069 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:38:34.153033    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:39:00.227793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:00.227751    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:39:00.227793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:00.227818    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:39:01.375563 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.375529    6126 generic.go:356] "Generic (PLEG): container finished" podID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerID="dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0" exitCode=0
Oct 30 23:39:01.376146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.375600    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerDied","Data":"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"}
Oct 30 23:39:01.376241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.376222    6126 scope.go:122] "RemoveContainer" containerID="dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"
Oct 30 23:39:01.378212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.378181    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:01.378361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.378269    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:01.378361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:01.378322    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:02.429044 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:02.429006    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerStarted","Data":"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"}
Oct 30 23:39:03.325645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:03.325318    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:39:03.325645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:03.325511    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:39:03.325645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:03.325561    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:39:04.152927 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:39:04.152886    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:39:04.324081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:04.324046    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:39:04.324304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:04.324107    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:39:05.324056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:05.324018    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:39:05.324487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:05.324090    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:39:06.325000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:06.324952    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:39:06.325531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:06.325012    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:39:07.333915 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:07.333871    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 23:39:07.334404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:07.333966    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 23:39:08.328681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:08.328654    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:39:08.329068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:08.329042    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:39:08.329559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:08.329537    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:39:22.652625 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.652586    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:39:22.653739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.653718    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy"
Oct 30 23:39:22.653739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.653738    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy"
Oct 30 23:39:22.653888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.653883    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d375ce5c-2079-4d10-b676-65ff5415257c" containerName="istio-proxy"
Oct 30 23:39:22.659294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.659276    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.716236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.716202    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:39:22.754968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.754932    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.755119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.755016    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.755199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.755125    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2glzh\" (UniqueName: \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.755251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.755210    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.760318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.760293    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7a42d8-serving-cert\""
Oct 30 23:39:22.856834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.856803    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.856993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.856866    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.856993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.856886    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2glzh\" (UniqueName: \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.856993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.856901    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.857189 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:39:22.857029    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-serving-cert: secret "maas-api-e2e-shared-b-w3-7a42d8-serving-cert" not found
Oct 30 23:39:22.857189 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:39:22.857092    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls podName:004115cd-af54-4059-9574-7058cb8a432d nodeName:}" failed. No retries permitted until 2026-10-30 23:39:23.357075788 +0000 UTC m=+1935.117168352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls") pod "maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" (UID: "004115cd-af54-4059-9574-7058cb8a432d") : secret "maas-api-e2e-shared-b-w3-7a42d8-serving-cert" not found
Oct 30 23:39:22.857484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.857463    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.859422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.859403    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:22.932286 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:22.932200    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2glzh\" (UniqueName: \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:23.372512 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:23.372479    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:23.375293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:23.375267    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:23.574434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:23.574400    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:23.965998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:23.965967    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:39:23.966779 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:39:23.966752    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004115cd_af54_4059_9574_7058cb8a432d.slice/crio-866b8fe65754a11162e02d60dd98218baa1e6e0b22a1f7ce3b26a78102f6006e WatchSource:0}: Error finding container 866b8fe65754a11162e02d60dd98218baa1e6e0b22a1f7ce3b26a78102f6006e: Status 404 returned error can't find the container with id 866b8fe65754a11162e02d60dd98218baa1e6e0b22a1f7ce3b26a78102f6006e
Oct 30 23:39:23.968162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:23.968143    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:39:24.617474 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:24.617440    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" event={"ID":"004115cd-af54-4059-9574-7058cb8a432d","Type":"ContainerStarted","Data":"866b8fe65754a11162e02d60dd98218baa1e6e0b22a1f7ce3b26a78102f6006e"}
Oct 30 23:39:25.630054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:25.630005    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" event={"ID":"004115cd-af54-4059-9574-7058cb8a432d","Type":"ContainerStarted","Data":"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"}
Oct 30 23:39:25.630573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:25.630114    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:25.752167 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:25.752100    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" podStartSLOduration=2.831916266 podStartE2EDuration="3.75208067s" totalImagesPullingTime="920.164404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:25.747782885 +0000 UTC m=+1937.507875456" watchObservedRunningTime="2026-10-30 23:39:25.75208067 +0000 UTC m=+1937.512173241"
Oct 30 23:39:31.642864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:39:31.642828    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:39:34.161318 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:39:34.161276    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:40:04.160325 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:40:04.160285    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:40:11.691257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:11.691221    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:40:11.807110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:11.807076    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:40:16.692579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:16.692485    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" podUID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" containerName="payload-processing" containerID="cri-o://c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48" gracePeriod=25
Oct 30 23:40:16.808013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:16.807953    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" podUID="404863bf-6773-47a7-825a-e06296196bb7" containerName="payload-pre-processing" containerID="cri-o://f50502cd118f091d9a30da2939938b63eb0e51bdc737da1f68ef91f4dbc97119" gracePeriod=25
Oct 30 23:40:17.002179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.002148    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:40:17.101493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.101466    6126 generic.go:356] "Generic (PLEG): container finished" podID="404863bf-6773-47a7-825a-e06296196bb7" containerID="f50502cd118f091d9a30da2939938b63eb0e51bdc737da1f68ef91f4dbc97119" exitCode=0
Oct 30 23:40:17.101677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.101548    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" event={"ID":"404863bf-6773-47a7-825a-e06296196bb7","Type":"ContainerDied","Data":"f50502cd118f091d9a30da2939938b63eb0e51bdc737da1f68ef91f4dbc97119"}
Oct 30 23:40:17.101677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.101640    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt" event={"ID":"404863bf-6773-47a7-825a-e06296196bb7","Type":"ContainerDied","Data":"4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b"}
Oct 30 23:40:17.101677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.101666    6126 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c0318c545f29d76fcd16ba978c06dba5e9384b9d5ac6d08b06428f35ce3cb0b"
Oct 30 23:40:17.103077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.103051    6126 generic.go:356] "Generic (PLEG): container finished" podID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" containerID="c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48" exitCode=0
Oct 30 23:40:17.103187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.103113    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"
Oct 30 23:40:17.103187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.103115    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" event={"ID":"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4","Type":"ContainerDied","Data":"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"}
Oct 30 23:40:17.103187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.103161    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8" event={"ID":"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4","Type":"ContainerDied","Data":"a3b3804c5de515243b326560be0ce97c5dbe77de2c0289a5df0cf0f06a680d51"}
Oct 30 23:40:17.103187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.103184    6126 scope.go:122] "RemoveContainer" containerID="c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"
Oct 30 23:40:17.118831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.117140    6126 scope.go:122] "RemoveContainer" containerID="c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"
Oct 30 23:40:17.118831 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:40:17.117464    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48\": container with ID starting with c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48 not found: ID does not exist" containerID="c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"
Oct 30 23:40:17.118831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.117496    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48"} err="failed to get container status \"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48\": rpc error: code = NotFound desc = could not find container \"c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48\": container with ID starting with c2e526499c23360db959a45473461b8e5d5c88e761d7ba4bace487682d3b9e48 not found: ID does not exist"
Oct 30 23:40:17.142467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.131314    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:40:17.143257 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.143230    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\" (UniqueName: \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\") pod \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") "
Oct 30 23:40:17.143740 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.143719    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\") pod \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\" (UID: \"736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4\") "
Oct 30 23:40:17.144543 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.144516    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume" pod "736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" (UID: "736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:40:17.147570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.146720    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln" pod "736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" (UID: "736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4"). InnerVolumeSpecName "kube-api-access-n2xln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:40:17.245507 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.245475    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\") pod \"404863bf-6773-47a7-825a-e06296196bb7\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") "
Oct 30 23:40:17.245864 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.245843    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\" (UniqueName: \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\") pod \"404863bf-6773-47a7-825a-e06296196bb7\" (UID: \"404863bf-6773-47a7-825a-e06296196bb7\") "
Oct 30 23:40:17.245933 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.245903    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume" pod "404863bf-6773-47a7-825a-e06296196bb7" (UID: "404863bf-6773-47a7-825a-e06296196bb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:40:17.246373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.246353    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404863bf-6773-47a7-825a-e06296196bb7-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:17.246669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.246373    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:17.246669 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.246387    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2xln\" (UniqueName: \"kubernetes.io/projected/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4-kube-api-access-n2xln\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:17.248111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.248086    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79" pod "404863bf-6773-47a7-825a-e06296196bb7" (UID: "404863bf-6773-47a7-825a-e06296196bb7"). InnerVolumeSpecName "kube-api-access-plq79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:40:17.354908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.354873    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plq79\" (UniqueName: \"kubernetes.io/projected/404863bf-6773-47a7-825a-e06296196bb7-kube-api-access-plq79\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:17.530796 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.530701    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:40:17.533434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:17.533408    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1ce657-64db4946cc-hlsw8"]
Oct 30 23:40:18.115185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:18.115158    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"
Oct 30 23:40:18.282718 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:18.282686    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:40:18.286333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:18.286304    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1ce657-5565b47cf5-5p5lt"]
Oct 30 23:40:18.412270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:18.412178    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="404863bf-6773-47a7-825a-e06296196bb7" path="/var/lib/kubelet/pods/404863bf-6773-47a7-825a-e06296196bb7/volumes"
Oct 30 23:40:18.412757 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:18.412732    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" path="/var/lib/kubelet/pods/736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4/volumes"
Oct 30 23:40:34.152916 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:40:34.152877    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:40:39.035402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.035363    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:40:39.036378 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.036333    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" podUID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" containerName="maas-api" containerID="cri-o://c3627ece7baa8137bb43b3f7b7ec162d9854cd09b44b4109a9d1c26aa64ce1a4" gracePeriod=30
Oct 30 23:40:39.346508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.346475    6126 generic.go:356] "Generic (PLEG): container finished" podID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" containerID="c3627ece7baa8137bb43b3f7b7ec162d9854cd09b44b4109a9d1c26aa64ce1a4" exitCode=0
Oct 30 23:40:39.347094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.347069    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" event={"ID":"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a","Type":"ContainerDied","Data":"c3627ece7baa8137bb43b3f7b7ec162d9854cd09b44b4109a9d1c26aa64ce1a4"}
Oct 30 23:40:39.373504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.373483    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:40:39.431348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.431293    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\") pod \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") "
Oct 30 23:40:39.431595 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.431397    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\") pod \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") "
Oct 30 23:40:39.431767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.431659    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\" (UniqueName: \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\") pod \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") "
Oct 30 23:40:39.431868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.431786    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") pod \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\" (UID: \"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a\") "
Oct 30 23:40:39.436237 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.436181    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn" pod "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" (UID: "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a"). InnerVolumeSpecName "kube-api-access-rqhcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:40:39.442189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.437643    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca" pod "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" (UID: "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:40:39.442189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.439851    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls" pod "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" (UID: "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:40:39.444337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.444308    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs" pod "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" (UID: "1bb2a5ff-1708-4d84-8357-4d5c57c4e72a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:40:39.540836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.540803    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqhcn\" (UniqueName: \"kubernetes.io/projected/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-kube-api-access-rqhcn\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:39.540836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.540834    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:39.540836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.540843    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:39.541154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:39.540852    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:40.356547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:40.356521    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"
Oct 30 23:40:40.357012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:40.356566    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv" event={"ID":"1bb2a5ff-1708-4d84-8357-4d5c57c4e72a","Type":"ContainerDied","Data":"e94675fa37aed092c906c38bfa2a802484460ecc7e3b7b41a7023706b613ccd1"}
Oct 30 23:40:40.357012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:40.356637    6126 scope.go:122] "RemoveContainer" containerID="c3627ece7baa8137bb43b3f7b7ec162d9854cd09b44b4109a9d1c26aa64ce1a4"
Oct 30 23:40:40.525925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:40.525886    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:40:40.573737 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:40.573707    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-55666687-7659595c45-nhvqv"]
Oct 30 23:40:42.412591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:42.412559    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" path="/var/lib/kubelet/pods/1bb2a5ff-1708-4d84-8357-4d5c57c4e72a/volumes"
Oct 30 23:40:53.833510 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:53.833470    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:40:53.944297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:53.944264    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:40:58.835167 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:58.835100    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" podUID="792a848c-f121-451d-9c8d-ddeae39fc71a" containerName="payload-processing" containerID="cri-o://890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b" gracePeriod=25
Oct 30 23:40:58.944905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:58.944860    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" podUID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" containerName="payload-pre-processing" containerID="cri-o://2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc" gracePeriod=25
Oct 30 23:40:59.155175 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.154838    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:40:59.249909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.249883    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:40:59.282388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.282361    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\" (UniqueName: \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\") pod \"792a848c-f121-451d-9c8d-ddeae39fc71a\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") "
Oct 30 23:40:59.282567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.282418    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\") pod \"792a848c-f121-451d-9c8d-ddeae39fc71a\" (UID: \"792a848c-f121-451d-9c8d-ddeae39fc71a\") "
Oct 30 23:40:59.283143 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.283112    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume" pod "792a848c-f121-451d-9c8d-ddeae39fc71a" (UID: "792a848c-f121-451d-9c8d-ddeae39fc71a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:40:59.283361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.283293    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/792a848c-f121-451d-9c8d-ddeae39fc71a-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:59.285105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.285065    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98" pod "792a848c-f121-451d-9c8d-ddeae39fc71a" (UID: "792a848c-f121-451d-9c8d-ddeae39fc71a"). InnerVolumeSpecName "kube-api-access-wdg98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:40:59.384478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.384388    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\" (UniqueName: \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\") pod \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") "
Oct 30 23:40:59.384673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.384534    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\") pod \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\" (UID: \"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4\") "
Oct 30 23:40:59.384932 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.384907    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume" pod "6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" (UID: "6b14ccbd-0d9f-474b-8e57-dd640c6d6db4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:40:59.385173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.385148    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdg98\" (UniqueName: \"kubernetes.io/projected/792a848c-f121-451d-9c8d-ddeae39fc71a-kube-api-access-wdg98\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:59.385173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.385172    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:59.386722 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.386702    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd" pod "6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" (UID: "6b14ccbd-0d9f-474b-8e57-dd640c6d6db4"). InnerVolumeSpecName "kube-api-access-2qpjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:40:59.487419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.487387    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qpjd\" (UniqueName: \"kubernetes.io/projected/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4-kube-api-access-2qpjd\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:40:59.512341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.512304    6126 generic.go:356] "Generic (PLEG): container finished" podID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" containerID="2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc" exitCode=0
Oct 30 23:40:59.512535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.512366    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"
Oct 30 23:40:59.512535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.512367    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" event={"ID":"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4","Type":"ContainerDied","Data":"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"}
Oct 30 23:40:59.512535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.512450    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf" event={"ID":"6b14ccbd-0d9f-474b-8e57-dd640c6d6db4","Type":"ContainerDied","Data":"508885cbff0548fd0e534fb14d226b72834e87c919dcb1d4f85edfb26546b99c"}
Oct 30 23:40:59.512535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.512481    6126 scope.go:122] "RemoveContainer" containerID="2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"
Oct 30 23:40:59.515428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.515402    6126 generic.go:356] "Generic (PLEG): container finished" podID="792a848c-f121-451d-9c8d-ddeae39fc71a" containerID="890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b" exitCode=0
Oct 30 23:40:59.515752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.515600    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" event={"ID":"792a848c-f121-451d-9c8d-ddeae39fc71a","Type":"ContainerDied","Data":"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"}
Oct 30 23:40:59.515849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.515785    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw" event={"ID":"792a848c-f121-451d-9c8d-ddeae39fc71a","Type":"ContainerDied","Data":"a60f7f1122d77529af21bf155d8acede58817c9641a059af7d9b96fffddb5a10"}
Oct 30 23:40:59.515917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.515858    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"
Oct 30 23:40:59.526450 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.526431    6126 scope.go:122] "RemoveContainer" containerID="2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"
Oct 30 23:40:59.526797 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:40:59.526768    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc\": container with ID starting with 2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc not found: ID does not exist" containerID="2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"
Oct 30 23:40:59.526878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.526806    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc"} err="failed to get container status \"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc\": rpc error: code = NotFound desc = could not find container \"2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc\": container with ID starting with 2e0bfbe6151b1cbfc49e9e502188dcc981eae2de17eb4582a77cb945e28c9dfc not found: ID does not exist"
Oct 30 23:40:59.526878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.526829    6126 scope.go:122] "RemoveContainer" containerID="890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"
Oct 30 23:40:59.537078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.537061    6126 scope.go:122] "RemoveContainer" containerID="890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"
Oct 30 23:40:59.537340 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:40:59.537317    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b\": container with ID starting with 890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b not found: ID does not exist" containerID="890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"
Oct 30 23:40:59.537403 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.537349    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b"} err="failed to get container status \"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b\": rpc error: code = NotFound desc = could not find container \"890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b\": container with ID starting with 890c4d060800edfd7fb853d45bef4f6769237945a582fc88723a7e61dc398e1b not found: ID does not exist"
Oct 30 23:40:59.681376 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.681278    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:40:59.686240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.686213    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-b526ac-b5b7c8f8c-7f4tw"]
Oct 30 23:40:59.798101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.798067    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:40:59.803430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:40:59.803402    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-b526ac-94678555-qfvnf"]
Oct 30 23:41:00.454149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:00.454095    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" path="/var/lib/kubelet/pods/6b14ccbd-0d9f-474b-8e57-dd640c6d6db4/volumes"
Oct 30 23:41:00.455439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:00.455404    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="792a848c-f121-451d-9c8d-ddeae39fc71a" path="/var/lib/kubelet/pods/792a848c-f121-451d-9c8d-ddeae39fc71a/volumes"
Oct 30 23:41:04.153610 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:41:04.153575    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:41:09.013076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:09.013044    6126 scope.go:122] "RemoveContainer" containerID="f50502cd118f091d9a30da2939938b63eb0e51bdc737da1f68ef91f4dbc97119"
Oct 30 23:41:13.537526 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:13.537490    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:41:13.652572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:13.652534    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:41:18.538278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.538240    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" podUID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" containerName="payload-processing" containerID="cri-o://2b58d0f3e6a4aecdd3ebc9c733c800a25f7b365565ca6c5de0ebeba115560a8c" gracePeriod=25
Oct 30 23:41:18.653436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.653395    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" podUID="f0e86d5a-3723-4f52-aed3-b75948b83543" containerName="payload-pre-processing" containerID="cri-o://1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023" gracePeriod=25
Oct 30 23:41:18.762779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.762588    6126 generic.go:356] "Generic (PLEG): container finished" podID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" containerID="2b58d0f3e6a4aecdd3ebc9c733c800a25f7b365565ca6c5de0ebeba115560a8c" exitCode=0
Oct 30 23:41:18.762779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.762654    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" event={"ID":"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198","Type":"ContainerDied","Data":"2b58d0f3e6a4aecdd3ebc9c733c800a25f7b365565ca6c5de0ebeba115560a8c"}
Oct 30 23:41:18.831481 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.831447    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:41:18.920912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.920151    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\" (UniqueName: \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\") pod \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") "
Oct 30 23:41:18.920912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.920266    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\") pod \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\" (UID: \"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198\") "
Oct 30 23:41:18.921927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.921717    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume" pod "11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" (UID: "11ca9dfb-6c91-4e9c-9335-eb71c6ba6198"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:41:18.921927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.921881    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:41:18.924009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.923981    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8" pod "11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" (UID: "11ca9dfb-6c91-4e9c-9335-eb71c6ba6198"). InnerVolumeSpecName "kube-api-access-kpfk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:41:18.960998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:18.960967    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:41:19.023328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.023299    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\" (UniqueName: \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\") pod \"f0e86d5a-3723-4f52-aed3-b75948b83543\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") "
Oct 30 23:41:19.023717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.023694    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\") pod \"f0e86d5a-3723-4f52-aed3-b75948b83543\" (UID: \"f0e86d5a-3723-4f52-aed3-b75948b83543\") "
Oct 30 23:41:19.024163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.024126    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume" pod "f0e86d5a-3723-4f52-aed3-b75948b83543" (UID: "f0e86d5a-3723-4f52-aed3-b75948b83543"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:41:19.024661 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.024598    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpfk8\" (UniqueName: \"kubernetes.io/projected/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198-kube-api-access-kpfk8\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:41:19.024728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.024672    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0e86d5a-3723-4f52-aed3-b75948b83543-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:41:19.025804 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.025783    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4" pod "f0e86d5a-3723-4f52-aed3-b75948b83543" (UID: "f0e86d5a-3723-4f52-aed3-b75948b83543"). InnerVolumeSpecName "kube-api-access-6brf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:41:19.126600 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.126514    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6brf4\" (UniqueName: \"kubernetes.io/projected/f0e86d5a-3723-4f52-aed3-b75948b83543-kube-api-access-6brf4\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:41:19.772033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.772002    6126 generic.go:356] "Generic (PLEG): container finished" podID="f0e86d5a-3723-4f52-aed3-b75948b83543" containerID="1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023" exitCode=0
Oct 30 23:41:19.772566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.772045    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"
Oct 30 23:41:19.772566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.772090    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" event={"ID":"f0e86d5a-3723-4f52-aed3-b75948b83543","Type":"ContainerDied","Data":"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"}
Oct 30 23:41:19.772566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.772147    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j" event={"ID":"f0e86d5a-3723-4f52-aed3-b75948b83543","Type":"ContainerDied","Data":"ce82228aea468071dd2240823df5f720f6e303c1738b89f33f3a723d42a14a3d"}
Oct 30 23:41:19.772566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.772175    6126 scope.go:122] "RemoveContainer" containerID="1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"
Oct 30 23:41:19.773990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.773953    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c" event={"ID":"11ca9dfb-6c91-4e9c-9335-eb71c6ba6198","Type":"ContainerDied","Data":"56f2c28099b264657f6284c9961b4c69fb084cbc071ed3b72955cf00ff388507"}
Oct 30 23:41:19.774097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.773961    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"
Oct 30 23:41:19.784252 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.784142    6126 scope.go:122] "RemoveContainer" containerID="1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"
Oct 30 23:41:19.784542 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:41:19.784446    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023\": container with ID starting with 1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023 not found: ID does not exist" containerID="1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"
Oct 30 23:41:19.784542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.784476    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023"} err="failed to get container status \"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023\": rpc error: code = NotFound desc = could not find container \"1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023\": container with ID starting with 1c3eb5dbc654495e1faeef896d3026856f6e6901778a588bd800d9182f797023 not found: ID does not exist"
Oct 30 23:41:19.784542 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.784500    6126 scope.go:122] "RemoveContainer" containerID="2b58d0f3e6a4aecdd3ebc9c733c800a25f7b365565ca6c5de0ebeba115560a8c"
Oct 30 23:41:19.942827 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.942750    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:41:19.991012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:19.990965    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-557e9b-7c988c6547-tmc4j"]
Oct 30 23:41:20.054442 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:20.054407    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:41:20.057686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:20.057664    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-557e9b-d5cc55cdf-v4n6c"]
Oct 30 23:41:20.408686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:20.408654    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" path="/var/lib/kubelet/pods/11ca9dfb-6c91-4e9c-9335-eb71c6ba6198/volumes"
Oct 30 23:41:20.409134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:41:20.409119    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0e86d5a-3723-4f52-aed3-b75948b83543" path="/var/lib/kubelet/pods/f0e86d5a-3723-4f52-aed3-b75948b83543/volumes"
Oct 30 23:41:34.153389 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:41:34.153351    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:42:04.152449 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:04.152372    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:42:08.818357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:08.818331    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:42:08.827745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:08.827719    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:42:21.127197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.127153    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:42:21.127803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.127425    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" podUID="df16f1ae-c582-4244-ad33-06e621610839" containerName="maas-api" containerID="cri-o://32b4e5828b553cd93ea727d694e37f20a097aa3f566e19e5e0507fcb4fad2c1a" gracePeriod=30
Oct 30 23:42:21.271424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.271392    6126 generic.go:356] "Generic (PLEG): container finished" podID="df16f1ae-c582-4244-ad33-06e621610839" containerID="32b4e5828b553cd93ea727d694e37f20a097aa3f566e19e5e0507fcb4fad2c1a" exitCode=0
Oct 30 23:42:21.271591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.271465    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" event={"ID":"df16f1ae-c582-4244-ad33-06e621610839","Type":"ContainerDied","Data":"32b4e5828b553cd93ea727d694e37f20a097aa3f566e19e5e0507fcb4fad2c1a"}
Oct 30 23:42:21.474059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.474034    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:42:21.622727 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.622555    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\") pod \"df16f1ae-c582-4244-ad33-06e621610839\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") "
Oct 30 23:42:21.622727 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.622724    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") pod \"df16f1ae-c582-4244-ad33-06e621610839\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") "
Oct 30 23:42:21.623001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.622818    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\") pod \"df16f1ae-c582-4244-ad33-06e621610839\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") "
Oct 30 23:42:21.623001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.622988    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\" (UniqueName: \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\") pod \"df16f1ae-c582-4244-ad33-06e621610839\" (UID: \"df16f1ae-c582-4244-ad33-06e621610839\") "
Oct 30 23:42:21.624547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.624516    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca" pod "df16f1ae-c582-4244-ad33-06e621610839" (UID: "df16f1ae-c582-4244-ad33-06e621610839"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:21.627758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.627734    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls" pod "df16f1ae-c582-4244-ad33-06e621610839" (UID: "df16f1ae-c582-4244-ad33-06e621610839"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:21.634830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.634787    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs" pod "df16f1ae-c582-4244-ad33-06e621610839" (UID: "df16f1ae-c582-4244-ad33-06e621610839"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:21.634830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.634818    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq" pod "df16f1ae-c582-4244-ad33-06e621610839" (UID: "df16f1ae-c582-4244-ad33-06e621610839"). InnerVolumeSpecName "kube-api-access-7hplq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:21.726732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.726688    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:21.727125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.727105    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df16f1ae-c582-4244-ad33-06e621610839-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:21.727336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.727284    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df16f1ae-c582-4244-ad33-06e621610839-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:21.727336 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:21.727305    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hplq\" (UniqueName: \"kubernetes.io/projected/df16f1ae-c582-4244-ad33-06e621610839-kube-api-access-7hplq\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:22.304320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:22.304280    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f" event={"ID":"df16f1ae-c582-4244-ad33-06e621610839","Type":"ContainerDied","Data":"09a9b02069d06836d6d47ae0c58d003943b2d269fd62b4c31ff9e041a44249c9"}
Oct 30 23:42:22.305236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:22.305210    6126 scope.go:122] "RemoveContainer" containerID="32b4e5828b553cd93ea727d694e37f20a097aa3f566e19e5e0507fcb4fad2c1a"
Oct 30 23:42:22.305664 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:22.305427    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"
Oct 30 23:42:22.478312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:22.478278    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:42:22.530111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:22.530077    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-557e9b-757f55c458-2zm8f"]
Oct 30 23:42:24.410121 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:24.410082    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df16f1ae-c582-4244-ad33-06e621610839" path="/var/lib/kubelet/pods/df16f1ae-c582-4244-ad33-06e621610839/volumes"
Oct 30 23:42:26.559882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.559846    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:42:26.560299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.560044    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerName="discovery" containerID="cri-o://3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98" gracePeriod=30
Oct 30 23:42:26.869323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.869298    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:42:26.913255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913216    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.913462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913265    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.913462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913321    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.913462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913409    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.913668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913458    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.913668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913506    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.914047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.913995    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:26.914465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.914444    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\") pod \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\" (UID: \"26fc637b-067e-4f94-a6e9-d3407eb10bc3\") "
Oct 30 23:42:26.915644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.915601    6126 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-ca-configmap\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:26.916344 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.916316    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:26.916582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.916545    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "kube-api-access-6j5pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:26.916754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.916651    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:26.916754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.916659    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:26.916894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.916826    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:26.917839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:26.917813    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs" pod "26fc637b-067e-4f94-a6e9-d3407eb10bc3" (UID: "26fc637b-067e-4f94-a6e9-d3407eb10bc3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:27.017982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.017939    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.017982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.017980    6126 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-kubeconfig\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.018251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.017996    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j5pz\" (UniqueName: \"kubernetes.io/projected/26fc637b-067e-4f94-a6e9-d3407eb10bc3-kube-api-access-6j5pz\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.018251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.018010    6126 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-istio-csr-dns-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.018251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.018025    6126 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26fc637b-067e-4f94-a6e9-d3407eb10bc3-cacerts\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.018251 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.018038    6126 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26fc637b-067e-4f94-a6e9-d3407eb10bc3-local-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:27.353038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.353004    6126 generic.go:356] "Generic (PLEG): container finished" podID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerID="3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98" exitCode=0
Oct 30 23:42:27.353245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.353051    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"
Oct 30 23:42:27.353245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.353089    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" event={"ID":"26fc637b-067e-4f94-a6e9-d3407eb10bc3","Type":"ContainerDied","Data":"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"}
Oct 30 23:42:27.353245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.353142    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962" event={"ID":"26fc637b-067e-4f94-a6e9-d3407eb10bc3","Type":"ContainerDied","Data":"106941b6f39a0957000058368caf8f317a919966aef5b0b9f39068521b132415"}
Oct 30 23:42:27.353245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.353169    6126 scope.go:122] "RemoveContainer" containerID="3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"
Oct 30 23:42:27.365137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.365116    6126 scope.go:122] "RemoveContainer" containerID="3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"
Oct 30 23:42:27.365409 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:27.365391    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98\": container with ID starting with 3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98 not found: ID does not exist" containerID="3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"
Oct 30 23:42:27.365499 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.365417    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98"} err="failed to get container status \"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98\": rpc error: code = NotFound desc = could not find container \"3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98\": container with ID starting with 3a1b68b1c2f13e306fd988c862fccd6421e1befdba4c0a5dd4aa75d738089b98 not found: ID does not exist"
Oct 30 23:42:27.523459 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.523421    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:42:27.572025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:27.571990    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wm962"]
Oct 30 23:42:28.433559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:28.433522    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" path="/var/lib/kubelet/pods/26fc637b-067e-4f94-a6e9-d3407eb10bc3/volumes"
Oct 30 23:42:30.348375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:30.348333    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:42:30.348819 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:30.348540    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy" containerID="cri-o://25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa" gracePeriod=30
Oct 30 23:42:33.409268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:33.409238    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:42:33.409785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:33.409440    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" containerID="cri-o://3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed" gracePeriod=30
Oct 30 23:42:33.460432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:33.460397    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:42:33.460686 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:33.460664    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" containerID="cri-o://45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43" gracePeriod=30
Oct 30 23:42:33.843302 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:33.843264    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:42:34.156959 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:34.156877    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:42:35.668227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.668074    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.787703    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.787782    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.787861    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.787931    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788079    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788110    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788168    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788394    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788582    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788198    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.788803    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\") pod \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\" (UID: \"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74\") "
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.789006    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.789548    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.789570    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.789585    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.790177    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:35.790916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.790466    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:35.792131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.792101    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "kube-api-access-r8gmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:35.792458 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.792433    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:42:35.792758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.792724    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:35.794202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.794179    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token" pod "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" (UID: "3fb8b9c8-d6ed-4554-8dde-5f32f5598d74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896778    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896810    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896825    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896840    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896853    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.897259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.896868    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8gmf\" (UniqueName: \"kubernetes.io/projected/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74-kube-api-access-r8gmf\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:35.905528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.905487    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:42:35.909070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:35.906007    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" containerID="cri-o://bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07" gracePeriod=30
Oct 30 23:42:36.431961 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.431926    6126 generic.go:356] "Generic (PLEG): container finished" podID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerID="25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa" exitCode=0
Oct 30 23:42:36.432099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.431974    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"
Oct 30 23:42:36.432099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.432010    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerDied","Data":"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"}
Oct 30 23:42:36.432099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.432064    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm" event={"ID":"3fb8b9c8-d6ed-4554-8dde-5f32f5598d74","Type":"ContainerDied","Data":"67e6fd3d69f60fc862d69997b1dd6b7cdfdb41cbb9b3b71ca3022f20529abcde"}
Oct 30 23:42:36.432099 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.432093    6126 scope.go:122] "RemoveContainer" containerID="25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"
Oct 30 23:42:36.442911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.442798    6126 scope.go:122] "RemoveContainer" containerID="da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"
Oct 30 23:42:36.453346 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.453319    6126 scope.go:122] "RemoveContainer" containerID="25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"
Oct 30 23:42:36.453693 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:36.453670    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa\": container with ID starting with 25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa not found: ID does not exist" containerID="25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"
Oct 30 23:42:36.453808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.453698    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa"} err="failed to get container status \"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa\": rpc error: code = NotFound desc = could not find container \"25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa\": container with ID starting with 25e10ca68009bb9ee07e0ad3468d2091a899232662e7223617d92e4dfc773baa not found: ID does not exist"
Oct 30 23:42:36.453808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.453715    6126 scope.go:122] "RemoveContainer" containerID="da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"
Oct 30 23:42:36.454019 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:36.453975    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38\": container with ID starting with da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38 not found: ID does not exist" containerID="da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"
Oct 30 23:42:36.454019 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.454004    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38"} err="failed to get container status \"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38\": rpc error: code = NotFound desc = could not find container \"da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38\": container with ID starting with da4de6910318e31e4b0b9d32019e61c52d837f97473bb9af853c285566efcc38 not found: ID does not exist"
Oct 30 23:42:36.598758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.598726    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:42:36.605210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:36.605173    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-557e9b-openshift-default-69f6c9cf5-l64vm"]
Oct 30 23:42:37.224646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.224573    6126 patch_prober.go:29] interesting pod/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:42:37.225132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.224662    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:42:37.611608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.611535    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-2hwf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:42:37.611608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.611592    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:42:37.874650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.874531    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:42:37.874831 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:37.874778    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" podUID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" containerName="maas-api" containerID="cri-o://856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f" gracePeriod=30
Oct 30 23:42:38.209445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.209414    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:42:38.259668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.256282    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\" (UniqueName: \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\") pod \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") "
Oct 30 23:42:38.259668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.256567    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\") pod \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") "
Oct 30 23:42:38.259668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.256739    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\") pod \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") "
Oct 30 23:42:38.259668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.256781    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") pod \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\" (UID: \"1f8d7623-86bf-4e6d-9edd-3ff62c13f398\") "
Oct 30 23:42:38.259668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.257596    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca" pod "1f8d7623-86bf-4e6d-9edd-3ff62c13f398" (UID: "1f8d7623-86bf-4e6d-9edd-3ff62c13f398"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:38.274380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.265730    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs" pod "1f8d7623-86bf-4e6d-9edd-3ff62c13f398" (UID: "1f8d7623-86bf-4e6d-9edd-3ff62c13f398"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:38.274380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.268365    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls" pod "1f8d7623-86bf-4e6d-9edd-3ff62c13f398" (UID: "1f8d7623-86bf-4e6d-9edd-3ff62c13f398"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:42:38.274380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.272731    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84" pod "1f8d7623-86bf-4e6d-9edd-3ff62c13f398" (UID: "1f8d7623-86bf-4e6d-9edd-3ff62c13f398"). InnerVolumeSpecName "kube-api-access-xwp84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:38.349219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.349175    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-v7lwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:42:38.349483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.349443    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:42:38.359016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.358986    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.359151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.359020    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.359151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.359036    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwp84\" (UniqueName: \"kubernetes.io/projected/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-kube-api-access-xwp84\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.359151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.359050    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f8d7623-86bf-4e6d-9edd-3ff62c13f398-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.408541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.408505    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" path="/var/lib/kubelet/pods/3fb8b9c8-d6ed-4554-8dde-5f32f5598d74/volumes"
Oct 30 23:42:38.460370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.460327    6126 generic.go:356] "Generic (PLEG): container finished" podID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" containerID="856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f" exitCode=0
Oct 30 23:42:38.460569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.460401    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" event={"ID":"1f8d7623-86bf-4e6d-9edd-3ff62c13f398","Type":"ContainerDied","Data":"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"}
Oct 30 23:42:38.460569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.460454    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh" event={"ID":"1f8d7623-86bf-4e6d-9edd-3ff62c13f398","Type":"ContainerDied","Data":"4f3ef93ccf6698b86f58e71af8c4e1db098a5c8b93561ffede0c744e54a3212a"}
Oct 30 23:42:38.460569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.460487    6126 scope.go:122] "RemoveContainer" containerID="856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"
Oct 30 23:42:38.460569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.460525    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"
Oct 30 23:42:38.543177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.543151    6126 scope.go:122] "RemoveContainer" containerID="856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"
Oct 30 23:42:38.543552 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:38.543531    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f\": container with ID starting with 856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f not found: ID does not exist" containerID="856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"
Oct 30 23:42:38.543635 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.543562    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f"} err="failed to get container status \"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f\": rpc error: code = NotFound desc = could not find container \"856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f\": container with ID starting with 856a12066a0450adb446cf0a1785be87ba15152e2e3af2907c1d65e2ed3e4a4f not found: ID does not exist"
Oct 30 23:42:38.630940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.630907    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:42:38.635130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.635101    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ce657-b79ffbdcd-znhmh"]
Oct 30 23:42:38.748409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.748382    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:42:38.776435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.776411    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:42:38.853681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.850703    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" podUID="5b904c3d-5de5-454d-9b4a-08ffe192048b" containerName="payload-processing" containerID="cri-o://d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8" gracePeriod=25
Oct 30 23:42:38.881663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.881610    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.882312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.882288    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.882503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.882486    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.883260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.882848    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.883457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.883440    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.905908    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.905979    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.906030    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.906093    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.906143    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.894803    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:38.909422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.908920    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.910097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.909998    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.910231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910109    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910157    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910232    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910267    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.910409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910296    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910324    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910376    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\") pod \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\" (UID: \"198506e5-5eb0-4718-be4a-d82ceff4b5f2\") "
Oct 30 23:42:38.910738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910507    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.910738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.910562    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\") pod \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\" (UID: \"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2\") "
Oct 30 23:42:38.911511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.911368    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.911511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.911397    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.911511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.911411    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.911511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.911427    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:38.911934 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.911765    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "kube-api-access-s5z9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:38.912351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.912130    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.912351 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.912172    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.912856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.912642    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:38.913162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.912991    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.913917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.913350    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.915902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.915877    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.917003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.916968    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.918577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.918541    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:42:38.919303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.919282    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:42:38.919562 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.919533    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token" pod "198506e5-5eb0-4718-be4a-d82ceff4b5f2" (UID: "198506e5-5eb0-4718-be4a-d82ceff4b5f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:38.920821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.920765    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "kube-api-access-sxbpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:38.924760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.924722    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:38.926479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:38.926450    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token" pod "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" (UID: "a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:39.014527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.014494    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.014757 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.014740    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxbpp\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-kube-api-access-sxbpp\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.014845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.014834    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.014931 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.014920    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.015051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.015036    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.015799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.015778    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.015962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.015949    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016044    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016126    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016203    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016279    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016400    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5z9j\" (UniqueName: \"kubernetes.io/projected/198506e5-5eb0-4718-be4a-d82ceff4b5f2-kube-api-access-s5z9j\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016478    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.016566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.016555    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198506e5-5eb0-4718-be4a-d82ceff4b5f2-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.194723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.194683    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:42:39.324214 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.324127    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\" (UniqueName: \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\") pod \"5b904c3d-5de5-454d-9b4a-08ffe192048b\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") "
Oct 30 23:42:39.324820 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.324791    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\") pod \"5b904c3d-5de5-454d-9b4a-08ffe192048b\" (UID: \"5b904c3d-5de5-454d-9b4a-08ffe192048b\") "
Oct 30 23:42:39.325572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.325350    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume" pod "5b904c3d-5de5-454d-9b4a-08ffe192048b" (UID: "5b904c3d-5de5-454d-9b4a-08ffe192048b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:39.325572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.325543    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b904c3d-5de5-454d-9b4a-08ffe192048b-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.327559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.327533    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf" pod "5b904c3d-5de5-454d-9b4a-08ffe192048b" (UID: "5b904c3d-5de5-454d-9b4a-08ffe192048b"). InnerVolumeSpecName "kube-api-access-wx2gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:39.427107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.427063    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx2gf\" (UniqueName: \"kubernetes.io/projected/5b904c3d-5de5-454d-9b4a-08ffe192048b-kube-api-access-wx2gf\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:39.470042 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.470008    6126 generic.go:356] "Generic (PLEG): container finished" podID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerID="45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43" exitCode=0
Oct 30 23:42:39.470220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.470059    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"
Oct 30 23:42:39.470220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.470093    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" event={"ID":"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2","Type":"ContainerDied","Data":"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"}
Oct 30 23:42:39.470220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.470150    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx" event={"ID":"a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2","Type":"ContainerDied","Data":"2cabf1e936767ad7b1de4d6770fb253c4024b60730b32a4eecafd6e2fb488d98"}
Oct 30 23:42:39.470220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.470179    6126 scope.go:122] "RemoveContainer" containerID="45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"
Oct 30 23:42:39.471483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.471463    6126 generic.go:356] "Generic (PLEG): container finished" podID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerID="3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed" exitCode=0
Oct 30 23:42:39.471605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.471511    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"
Oct 30 23:42:39.471605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.471548    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" event={"ID":"198506e5-5eb0-4718-be4a-d82ceff4b5f2","Type":"ContainerDied","Data":"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"}
Oct 30 23:42:39.471752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.471607    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2" event={"ID":"198506e5-5eb0-4718-be4a-d82ceff4b5f2","Type":"ContainerDied","Data":"61b0ef62466e30aedaf17288c5636f29897c5ba0ae012e7f52d5c20153c9d7b1"}
Oct 30 23:42:39.474354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.474330    6126 generic.go:356] "Generic (PLEG): container finished" podID="5b904c3d-5de5-454d-9b4a-08ffe192048b" containerID="d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8" exitCode=0
Oct 30 23:42:39.474455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.474365    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"
Oct 30 23:42:39.474536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.474365    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" event={"ID":"5b904c3d-5de5-454d-9b4a-08ffe192048b","Type":"ContainerDied","Data":"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"}
Oct 30 23:42:39.474536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.474507    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm" event={"ID":"5b904c3d-5de5-454d-9b4a-08ffe192048b","Type":"ContainerDied","Data":"3a4ee93c907e31a67dcfd82671e6040c9f7ac08723a9dca6318175d2ae34c0d0"}
Oct 30 23:42:39.482408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.482374    6126 scope.go:122] "RemoveContainer" containerID="45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"
Oct 30 23:42:39.482802 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:39.482715    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43\": container with ID starting with 45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43 not found: ID does not exist" containerID="45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"
Oct 30 23:42:39.482802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.482751    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43"} err="failed to get container status \"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43\": rpc error: code = NotFound desc = could not find container \"45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43\": container with ID starting with 45e3ab5a2f715c11c97d032a61d3a2d28bf914e4101b544253d2d257d3925f43 not found: ID does not exist"
Oct 30 23:42:39.482802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.482776    6126 scope.go:122] "RemoveContainer" containerID="3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"
Oct 30 23:42:39.495160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.495136    6126 scope.go:122] "RemoveContainer" containerID="3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"
Oct 30 23:42:39.495433 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:39.495408    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed\": container with ID starting with 3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed not found: ID does not exist" containerID="3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"
Oct 30 23:42:39.495501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.495445    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed"} err="failed to get container status \"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed\": rpc error: code = NotFound desc = could not find container \"3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed\": container with ID starting with 3276db7d2ba8e10180ad3f27fa29c2e84af1a593e0314b5688a49d79ce7251ed not found: ID does not exist"
Oct 30 23:42:39.495501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.495470    6126 scope.go:122] "RemoveContainer" containerID="d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"
Oct 30 23:42:39.505923 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.505905    6126 scope.go:122] "RemoveContainer" containerID="d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"
Oct 30 23:42:39.506202 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:39.506182    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8\": container with ID starting with d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8 not found: ID does not exist" containerID="d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"
Oct 30 23:42:39.506282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.506208    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8"} err="failed to get container status \"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8\": rpc error: code = NotFound desc = could not find container \"d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8\": container with ID starting with d8c2b6d08dce73f0a542c0cfed4578fa41c4a4204718d8e40395d3ccb6b2ecf8 not found: ID does not exist"
Oct 30 23:42:39.638800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.638723    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:42:39.643244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.643216    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-2hwf2"]
Oct 30 23:42:39.753944 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.753912    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:42:39.759501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.759474    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-v7lwx"]
Oct 30 23:42:39.869107 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.869074    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:42:39.875295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:39.875263    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-196ff7-7477bd9cf-gzmfm"]
Oct 30 23:42:40.411451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:40.411418    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" path="/var/lib/kubelet/pods/198506e5-5eb0-4718-be4a-d82ceff4b5f2/volumes"
Oct 30 23:42:40.412120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:40.412101    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" path="/var/lib/kubelet/pods/1f8d7623-86bf-4e6d-9edd-3ff62c13f398/volumes"
Oct 30 23:42:40.412665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:40.412645    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b904c3d-5de5-454d-9b4a-08ffe192048b" path="/var/lib/kubelet/pods/5b904c3d-5de5-454d-9b4a-08ffe192048b/volumes"
Oct 30 23:42:40.413674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:40.413651    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" path="/var/lib/kubelet/pods/a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2/volumes"
Oct 30 23:42:41.239711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.239686    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:42:41.356137 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356105    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356168    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356294    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356320    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356445 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356429    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356460    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356491    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356564    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.356849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356690    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:41.356849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356798    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:41.356849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356782    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:41.356849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.356810    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:41.357152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357038    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\") pod \"fddd76a8-a82a-4d6c-ba36-b7565617780e\" (UID: \"fddd76a8-a82a-4d6c-ba36-b7565617780e\") "
Oct 30 23:42:41.357532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357508    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:41.357973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357940    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fddd76a8-a82a-4d6c-ba36-b7565617780e-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.357973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357967    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.358146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357983    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.358146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.357997    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.358146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.358010    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.359129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.359104    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:41.359242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.359221    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:42:41.359339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.359315    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:42:41.359495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.359478    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6" pod "fddd76a8-a82a-4d6c-ba36-b7565617780e" (UID: "fddd76a8-a82a-4d6c-ba36-b7565617780e"). InnerVolumeSpecName "kube-api-access-z76t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:41.460081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.460002    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.460081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.460040    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.460081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.460055    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z76t6\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-kube-api-access-z76t6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.460081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.460068    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fddd76a8-a82a-4d6c-ba36-b7565617780e-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:41.497212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.497166    6126 generic.go:356] "Generic (PLEG): container finished" podID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerID="bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07" exitCode=0
Oct 30 23:42:41.497407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.497233    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"
Oct 30 23:42:41.497407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.497245    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" event={"ID":"fddd76a8-a82a-4d6c-ba36-b7565617780e","Type":"ContainerDied","Data":"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"}
Oct 30 23:42:41.497407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.497306    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5" event={"ID":"fddd76a8-a82a-4d6c-ba36-b7565617780e","Type":"ContainerDied","Data":"c50715a3fedf677ee3343e06687cd1d702086265556d9b1674152fe101165e54"}
Oct 30 23:42:41.497407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.497339    6126 scope.go:122] "RemoveContainer" containerID="bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"
Oct 30 23:42:41.509375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.509358    6126 scope.go:122] "RemoveContainer" containerID="bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"
Oct 30 23:42:41.509724 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:41.509700    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07\": container with ID starting with bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07 not found: ID does not exist" containerID="bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"
Oct 30 23:42:41.509813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.509735    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07"} err="failed to get container status \"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07\": rpc error: code = NotFound desc = could not find container \"bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07\": container with ID starting with bf5e2279bd35d4479a515df7d45acd3a8cfed9a3780fab9d69ce3e6772fcfd07 not found: ID does not exist"
Oct 30 23:42:41.673805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.673772    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:42:41.678383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:41.678357    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-nh2b5"]
Oct 30 23:42:42.408904 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:42.408870    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" path="/var/lib/kubelet/pods/fddd76a8-a82a-4d6c-ba36-b7565617780e/volumes"
Oct 30 23:42:42.706748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:42.706647    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:42:42.821896 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:42.821866    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:42:47.707205 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:47.707166    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" podUID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" containerName="payload-processing" containerID="cri-o://61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442" gracePeriod=25
Oct 30 23:42:47.822994 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:47.822919    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" podUID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" containerName="payload-pre-processing" containerID="cri-o://0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4" gracePeriod=25
Oct 30 23:42:48.007081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.007048    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:42:48.058566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.058511    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\") pod \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") "
Oct 30 23:42:48.058823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.058695    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\" (UniqueName: \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\") pod \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\" (UID: \"e6ceeecd-8be8-4f89-a956-befef0c2b31d\") "
Oct 30 23:42:48.058968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.058950    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume" pod "e6ceeecd-8be8-4f89-a956-befef0c2b31d" (UID: "e6ceeecd-8be8-4f89-a956-befef0c2b31d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:48.059540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.059349    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6ceeecd-8be8-4f89-a956-befef0c2b31d-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:48.062865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.062835    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8" pod "e6ceeecd-8be8-4f89-a956-befef0c2b31d" (UID: "e6ceeecd-8be8-4f89-a956-befef0c2b31d"). InnerVolumeSpecName "kube-api-access-5t7m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:48.114829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.114803    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:42:48.160838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.160788    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\") pod \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") "
Oct 30 23:42:48.161015 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.160926    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\" (UniqueName: \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\") pod \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\" (UID: \"22e95bf1-07b1-4fd7-990c-6a390da6e4e1\") "
Oct 30 23:42:48.161227 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.161200    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume" pod "22e95bf1-07b1-4fd7-990c-6a390da6e4e1" (UID: "22e95bf1-07b1-4fd7-990c-6a390da6e4e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:42:48.161389 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.161373    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:48.161431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.161393    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t7m8\" (UniqueName: \"kubernetes.io/projected/e6ceeecd-8be8-4f89-a956-befef0c2b31d-kube-api-access-5t7m8\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:48.163733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.163711    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t" pod "22e95bf1-07b1-4fd7-990c-6a390da6e4e1" (UID: "22e95bf1-07b1-4fd7-990c-6a390da6e4e1"). InnerVolumeSpecName "kube-api-access-b7n5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:48.262348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.262271    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7n5t\" (UniqueName: \"kubernetes.io/projected/22e95bf1-07b1-4fd7-990c-6a390da6e4e1-kube-api-access-b7n5t\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:42:48.556429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.556330    6126 generic.go:356] "Generic (PLEG): container finished" podID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" containerID="61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442" exitCode=0
Oct 30 23:42:48.556429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.556393    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"
Oct 30 23:42:48.556429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.556414    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" event={"ID":"e6ceeecd-8be8-4f89-a956-befef0c2b31d","Type":"ContainerDied","Data":"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"}
Oct 30 23:42:48.556733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.556488    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx" event={"ID":"e6ceeecd-8be8-4f89-a956-befef0c2b31d","Type":"ContainerDied","Data":"8624033d61bb34180840eef0c63f57ef084cb170dfc4a418b01b22cc71ed7127"}
Oct 30 23:42:48.556733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.556512    6126 scope.go:122] "RemoveContainer" containerID="61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"
Oct 30 23:42:48.558054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.558032    6126 generic.go:356] "Generic (PLEG): container finished" podID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" containerID="0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4" exitCode=0
Oct 30 23:42:48.558189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.558077    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"
Oct 30 23:42:48.558189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.558100    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" event={"ID":"22e95bf1-07b1-4fd7-990c-6a390da6e4e1","Type":"ContainerDied","Data":"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"}
Oct 30 23:42:48.558189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.558144    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm" event={"ID":"22e95bf1-07b1-4fd7-990c-6a390da6e4e1","Type":"ContainerDied","Data":"44ccb856b3608983f155996d8a9cc5dbe2d77fbf731696630d33c6eb90d01731"}
Oct 30 23:42:48.567302 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.567284    6126 scope.go:122] "RemoveContainer" containerID="61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"
Oct 30 23:42:48.567595 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:48.567576    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442\": container with ID starting with 61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442 not found: ID does not exist" containerID="61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"
Oct 30 23:42:48.567680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.567601    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442"} err="failed to get container status \"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442\": rpc error: code = NotFound desc = could not find container \"61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442\": container with ID starting with 61c1e3fa0623f3d8d048d3932867ee38b977148b79e571fdfb7a59605bcdb442 not found: ID does not exist"
Oct 30 23:42:48.567680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.567648    6126 scope.go:122] "RemoveContainer" containerID="0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"
Oct 30 23:42:48.576978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.576947    6126 scope.go:122] "RemoveContainer" containerID="0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"
Oct 30 23:42:48.577248 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:42:48.577230    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4\": container with ID starting with 0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4 not found: ID does not exist" containerID="0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"
Oct 30 23:42:48.577299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.577255    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4"} err="failed to get container status \"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4\": rpc error: code = NotFound desc = could not find container \"0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4\": container with ID starting with 0f82f5bc1cf724052afaf0846f427fed53eb9d496ef7c98260e62320cfc9b0f4 not found: ID does not exist"
Oct 30 23:42:48.722941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.722903    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:42:48.726874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.726848    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7a42d8-696d77489c-rx9kx"]
Oct 30 23:42:48.837865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.837787    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:42:48.839942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:48.839922    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a42d8-675594566c-vd2cm"]
Oct 30 23:42:50.408199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:50.408163    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" path="/var/lib/kubelet/pods/22e95bf1-07b1-4fd7-990c-6a390da6e4e1/volumes"
Oct 30 23:42:50.408592 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:50.408564    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" path="/var/lib/kubelet/pods/e6ceeecd-8be8-4f89-a956-befef0c2b31d/volumes"
Oct 30 23:42:58.750333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:58.750295    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:42:58.860721 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:42:58.860689    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:43:03.750674 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:03.750607    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" podUID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" containerName="payload-processing" containerID="cri-o://a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87" gracePeriod=25
Oct 30 23:43:03.861498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:03.861456    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" podUID="b1e301a2-c297-45ae-a892-2d610b58cb93" containerName="payload-pre-processing" containerID="cri-o://44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299" gracePeriod=25
Oct 30 23:43:04.032177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.032148    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:43:04.100886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.100851    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\" (UniqueName: \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\") pod \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") "
Oct 30 23:43:04.101186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.101158    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\") pod \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\" (UID: \"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437\") "
Oct 30 23:43:04.101666 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.101637    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume" pod "0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" (UID: "0ce14eb2-2b79-4337-8bbe-2ab0b5cca437"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:04.101893 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.101870    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:04.104255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.104225    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh" pod "0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" (UID: "0ce14eb2-2b79-4337-8bbe-2ab0b5cca437"). InnerVolumeSpecName "kube-api-access-gw8vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:04.142430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.142406    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:43:04.160004 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:04.159954    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:43:04.203233 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.203200    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\") pod \"b1e301a2-c297-45ae-a892-2d610b58cb93\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") "
Oct 30 23:43:04.203405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.203269    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\" (UniqueName: \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\") pod \"b1e301a2-c297-45ae-a892-2d610b58cb93\" (UID: \"b1e301a2-c297-45ae-a892-2d610b58cb93\") "
Oct 30 23:43:04.203582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.203559    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume" pod "b1e301a2-c297-45ae-a892-2d610b58cb93" (UID: "b1e301a2-c297-45ae-a892-2d610b58cb93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:04.203979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.203960    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1e301a2-c297-45ae-a892-2d610b58cb93-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:04.204057 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.203984    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw8vh\" (UniqueName: \"kubernetes.io/projected/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437-kube-api-access-gw8vh\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:04.205676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.205653    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn" pod "b1e301a2-c297-45ae-a892-2d610b58cb93" (UID: "b1e301a2-c297-45ae-a892-2d610b58cb93"). InnerVolumeSpecName "kube-api-access-6s8wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:04.305891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.305803    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s8wn\" (UniqueName: \"kubernetes.io/projected/b1e301a2-c297-45ae-a892-2d610b58cb93-kube-api-access-6s8wn\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:04.688244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.688147    6126 generic.go:356] "Generic (PLEG): container finished" podID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" containerID="a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87" exitCode=0
Oct 30 23:43:04.688244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.688206    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"
Oct 30 23:43:04.688467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.688245    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" event={"ID":"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437","Type":"ContainerDied","Data":"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"}
Oct 30 23:43:04.688467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.688313    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q" event={"ID":"0ce14eb2-2b79-4337-8bbe-2ab0b5cca437","Type":"ContainerDied","Data":"4c059b02be4c3439e6a8368d889f00a5d13fac726a00e646ac2d9566f181fb9a"}
Oct 30 23:43:04.688467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.688344    6126 scope.go:122] "RemoveContainer" containerID="a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"
Oct 30 23:43:04.689984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.689961    6126 generic.go:356] "Generic (PLEG): container finished" podID="b1e301a2-c297-45ae-a892-2d610b58cb93" containerID="44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299" exitCode=0
Oct 30 23:43:04.690111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.690089    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" event={"ID":"b1e301a2-c297-45ae-a892-2d610b58cb93","Type":"ContainerDied","Data":"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"}
Oct 30 23:43:04.690182 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.690123    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"
Oct 30 23:43:04.690331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.690131    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp" event={"ID":"b1e301a2-c297-45ae-a892-2d610b58cb93","Type":"ContainerDied","Data":"57c0e3afae31962661ae75a539fa1e821476a0433a5e5ce67956df9176229608"}
Oct 30 23:43:04.699556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.699533    6126 scope.go:122] "RemoveContainer" containerID="a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"
Oct 30 23:43:04.699908 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:04.699882    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87\": container with ID starting with a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87 not found: ID does not exist" containerID="a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"
Oct 30 23:43:04.699967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.699921    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87"} err="failed to get container status \"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87\": rpc error: code = NotFound desc = could not find container \"a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87\": container with ID starting with a87412e45fbd75422a94327305587e5684f3e2e7d54443cf9c029349758d7d87 not found: ID does not exist"
Oct 30 23:43:04.699967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.699945    6126 scope.go:122] "RemoveContainer" containerID="44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"
Oct 30 23:43:04.716812 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.716784    6126 scope.go:122] "RemoveContainer" containerID="44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"
Oct 30 23:43:04.717205 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:04.717169    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299\": container with ID starting with 44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299 not found: ID does not exist" containerID="44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"
Oct 30 23:43:04.717313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.717217    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299"} err="failed to get container status \"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299\": rpc error: code = NotFound desc = could not find container \"44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299\": container with ID starting with 44ab5331b41da0258f7ac6b85e459bc0d83a8acb02d17248184d3dc57f660299 not found: ID does not exist"
Oct 30 23:43:04.854525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.854485    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:43:04.858567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.858540    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ba13e7-5865bd87c5-25qpp"]
Oct 30 23:43:04.972927 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.972889    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:43:04.985661 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:04.985607    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ba13e7-5c8cfb7cf5-sdd7q"]
Oct 30 23:43:05.264209 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:05.264123    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:43:05.264416 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:05.264390    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy" containerID="cri-o://fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382" gracePeriod=30
Oct 30 23:43:06.408943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:06.408894    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" path="/var/lib/kubelet/pods/0ce14eb2-2b79-4337-8bbe-2ab0b5cca437/volumes"
Oct 30 23:43:06.409461 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:06.409432    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1e301a2-c297-45ae-a892-2d610b58cb93" path="/var/lib/kubelet/pods/b1e301a2-c297-45ae-a892-2d610b58cb93/volumes"
Oct 30 23:43:10.551866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.551831    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:43:10.596162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596127    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596166    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596210    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596239    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596337    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596429    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596466    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596556    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596572    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:10.596783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596748    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\") pod \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\" (UID: \"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8\") "
Oct 30 23:43:10.596980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596948    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:10.597049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.596977    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:10.597202 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597174    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:10.597281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597234    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:10.597580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597561    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.597663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597587    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.597663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597601    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.597663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597633    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.597663 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.597647    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.599132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.599102    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:10.599387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.599364    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:43:10.599462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.599384    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:10.599930 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.599901    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2" pod "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" (UID: "9e0f4157-29b4-48bb-b670-a7ffbaf55fc8"). InnerVolumeSpecName "kube-api-access-bkgw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:10.698979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.698938    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkgw2\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-kube-api-access-bkgw2\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.698979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.698980    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.699194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.698995    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.699194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.699008    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:10.774987 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.774947    6126 generic.go:356] "Generic (PLEG): container finished" podID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerID="fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382" exitCode=0
Oct 30 23:43:10.775177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.775004    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"
Oct 30 23:43:10.775177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.775041    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" event={"ID":"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8","Type":"ContainerDied","Data":"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"}
Oct 30 23:43:10.775177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.775099    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64" event={"ID":"9e0f4157-29b4-48bb-b670-a7ffbaf55fc8","Type":"ContainerDied","Data":"d589dd854670255c22dd3c691b230d22ac89748d2d5ba2e5e93c288ae227cc1e"}
Oct 30 23:43:10.775177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.775132    6126 scope.go:122] "RemoveContainer" containerID="fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"
Oct 30 23:43:10.787225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.787206    6126 scope.go:122] "RemoveContainer" containerID="fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"
Oct 30 23:43:10.787545 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:10.787527    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382\": container with ID starting with fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382 not found: ID does not exist" containerID="fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"
Oct 30 23:43:10.787637 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.787555    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382"} err="failed to get container status \"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382\": rpc error: code = NotFound desc = could not find container \"fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382\": container with ID starting with fad6e34d448535846920450c98573b85f50bd1ad01857852884416f104b94382 not found: ID does not exist"
Oct 30 23:43:10.948115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.948085    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:43:10.950995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:10.950973    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5dc3c0-openshift-default-5d4456f8c9-rzl64"]
Oct 30 23:43:12.410768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:12.410731    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" path="/var/lib/kubelet/pods/9e0f4157-29b4-48bb-b670-a7ffbaf55fc8/volumes"
Oct 30 23:43:27.642476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:27.642386    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:43:27.745667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:27.745609    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:43:32.642907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.642863    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" podUID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" containerName="payload-processing" containerID="cri-o://a6d0a17a8154a009e83e5e1c49b694a68bf667bda4cbb2e6ede0a7f446662209" gracePeriod=25
Oct 30 23:43:32.908134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.908080    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" podUID="33cc25df-9a3e-4e27-a23b-48e586e99269" containerName="payload-pre-processing" containerID="cri-o://6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9" gracePeriod=25
Oct 30 23:43:32.942809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.942783    6126 generic.go:356] "Generic (PLEG): container finished" podID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" containerID="a6d0a17a8154a009e83e5e1c49b694a68bf667bda4cbb2e6ede0a7f446662209" exitCode=0
Oct 30 23:43:32.942911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.942851    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" event={"ID":"18cbeeb7-f070-47b5-b56f-4e53e6c01a74","Type":"ContainerDied","Data":"a6d0a17a8154a009e83e5e1c49b694a68bf667bda4cbb2e6ede0a7f446662209"}
Oct 30 23:43:32.942911 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.942900    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74" event={"ID":"18cbeeb7-f070-47b5-b56f-4e53e6c01a74","Type":"ContainerDied","Data":"c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06"}
Oct 30 23:43:32.942987 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.942915    6126 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c18abc5c968b43153216936c275a680d5d04213b08fad0e022c6184a83dbce06"
Oct 30 23:43:32.992749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:32.992726    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:43:33.108753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.108719    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\") pod \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") "
Oct 30 23:43:33.108971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.108825    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\" (UniqueName: \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\") pod \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\" (UID: \"18cbeeb7-f070-47b5-b56f-4e53e6c01a74\") "
Oct 30 23:43:33.118567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.118511    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume" pod "18cbeeb7-f070-47b5-b56f-4e53e6c01a74" (UID: "18cbeeb7-f070-47b5-b56f-4e53e6c01a74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:33.133653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.133594    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm" pod "18cbeeb7-f070-47b5-b56f-4e53e6c01a74" (UID: "18cbeeb7-f070-47b5-b56f-4e53e6c01a74"). InnerVolumeSpecName "kube-api-access-4gkwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:33.183386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.183359    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:43:33.210693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.210663    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gkwm\" (UniqueName: \"kubernetes.io/projected/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-kube-api-access-4gkwm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:33.210693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.210692    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18cbeeb7-f070-47b5-b56f-4e53e6c01a74-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:33.313029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.312992    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\" (UniqueName: \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\") pod \"33cc25df-9a3e-4e27-a23b-48e586e99269\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") "
Oct 30 23:43:33.316675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.314309    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\") pod \"33cc25df-9a3e-4e27-a23b-48e586e99269\" (UID: \"33cc25df-9a3e-4e27-a23b-48e586e99269\") "
Oct 30 23:43:33.317037 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.317008    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume" pod "33cc25df-9a3e-4e27-a23b-48e586e99269" (UID: "33cc25df-9a3e-4e27-a23b-48e586e99269"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:33.317418 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.317394    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33cc25df-9a3e-4e27-a23b-48e586e99269-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:33.318525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.318491    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx" pod "33cc25df-9a3e-4e27-a23b-48e586e99269" (UID: "33cc25df-9a3e-4e27-a23b-48e586e99269"). InnerVolumeSpecName "kube-api-access-lrxqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:33.419197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.419109    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrxqx\" (UniqueName: \"kubernetes.io/projected/33cc25df-9a3e-4e27-a23b-48e586e99269-kube-api-access-lrxqx\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:43:33.953886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.953849    6126 generic.go:356] "Generic (PLEG): container finished" podID="33cc25df-9a3e-4e27-a23b-48e586e99269" containerID="6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9" exitCode=0
Oct 30 23:43:33.954345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.953905    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"
Oct 30 23:43:33.954345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.953930    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" event={"ID":"33cc25df-9a3e-4e27-a23b-48e586e99269","Type":"ContainerDied","Data":"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"}
Oct 30 23:43:33.954345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.953989    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc" event={"ID":"33cc25df-9a3e-4e27-a23b-48e586e99269","Type":"ContainerDied","Data":"801b53a92a455c90e3a8081dedf43523b4f90bd1e51e17cca68fe0f4355894d7"}
Oct 30 23:43:33.954345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.954013    6126 scope.go:122] "RemoveContainer" containerID="6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"
Oct 30 23:43:33.954345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.954050    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"
Oct 30 23:43:33.963852 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.963827    6126 scope.go:122] "RemoveContainer" containerID="6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"
Oct 30 23:43:33.964158 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:33.964138    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9\": container with ID starting with 6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9 not found: ID does not exist" containerID="6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"
Oct 30 23:43:33.964237 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:33.964172    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9"} err="failed to get container status \"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9\": rpc error: code = NotFound desc = could not find container \"6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9\": container with ID starting with 6e929b6ce997dfe7d16b805a9fac4c5c9ba4740815de6cc017235ba990764de9 not found: ID does not exist"
Oct 30 23:43:34.152646 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:43:34.152589    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:43:34.189646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.189522    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:43:34.235146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.235112    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bcc619-56f4999cf5-pfrsc"]
Oct 30 23:43:34.300249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.300207    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:43:34.303093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.303064    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bcc619-9fffb94b7-rhs74"]
Oct 30 23:43:34.407909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.407876    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" path="/var/lib/kubelet/pods/18cbeeb7-f070-47b5-b56f-4e53e6c01a74/volumes"
Oct 30 23:43:34.408421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:34.408399    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33cc25df-9a3e-4e27-a23b-48e586e99269" path="/var/lib/kubelet/pods/33cc25df-9a3e-4e27-a23b-48e586e99269/volumes"
Oct 30 23:43:42.793203 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793159    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:43:42.793839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793824    6126 cpu_manager.go:414] "containerMap: removing container" podUID="404863bf-6773-47a7-825a-e06296196bb7" containerName="payload-pre-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793840    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="404863bf-6773-47a7-825a-e06296196bb7" containerName="payload-pre-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793857    6126 cpu_manager.go:414] "containerMap: removing container" podUID="5b904c3d-5de5-454d-9b4a-08ffe192048b" containerName="payload-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793864    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b904c3d-5de5-454d-9b4a-08ffe192048b" containerName="payload-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793875    6126 cpu_manager.go:414] "containerMap: removing container" podUID="792a848c-f121-451d-9c8d-ddeae39fc71a" containerName="payload-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793880    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="792a848c-f121-451d-9c8d-ddeae39fc71a" containerName="payload-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793889    6126 cpu_manager.go:414] "containerMap: removing container" podUID="f0e86d5a-3723-4f52-aed3-b75948b83543" containerName="payload-pre-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793893    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0e86d5a-3723-4f52-aed3-b75948b83543" containerName="payload-pre-processing"
Oct 30 23:43:42.793900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793901    6126 cpu_manager.go:414] "containerMap: removing container" podUID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793906    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793915    6126 cpu_manager.go:414] "containerMap: removing container" podUID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793920    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793926    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793930    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793941    6126 cpu_manager.go:414] "containerMap: removing container" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793945    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793953    6126 cpu_manager.go:414] "containerMap: removing container" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793957    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793966    6126 cpu_manager.go:414] "containerMap: removing container" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793971    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793978    6126 cpu_manager.go:414] "containerMap: removing container" podUID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793982    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793995    6126 cpu_manager.go:414] "containerMap: removing container" podUID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.793999    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794008    6126 cpu_manager.go:414] "containerMap: removing container" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerName="discovery"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794012    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerName="discovery"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794021    6126 cpu_manager.go:414] "containerMap: removing container" podUID="b1e301a2-c297-45ae-a892-2d610b58cb93" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794025    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e301a2-c297-45ae-a892-2d610b58cb93" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794034    6126 cpu_manager.go:414] "containerMap: removing container" podUID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794038    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794046    6126 cpu_manager.go:414] "containerMap: removing container" podUID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794050    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794060    6126 cpu_manager.go:414] "containerMap: removing container" podUID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794064    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794075    6126 cpu_manager.go:414] "containerMap: removing container" podUID="33cc25df-9a3e-4e27-a23b-48e586e99269" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794080    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33cc25df-9a3e-4e27-a23b-48e586e99269" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794087    6126 cpu_manager.go:414] "containerMap: removing container" podUID="df16f1ae-c582-4244-ad33-06e621610839" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794092    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df16f1ae-c582-4244-ad33-06e621610839" containerName="maas-api"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794098    6126 cpu_manager.go:414] "containerMap: removing container" podUID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794102    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" containerName="payload-pre-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794110    6126 cpu_manager.go:414] "containerMap: removing container" podUID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794114    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" containerName="payload-processing"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794127    6126 cpu_manager.go:414] "containerMap: removing container" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794132    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794139    6126 cpu_manager.go:414] "containerMap: removing container" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.794154 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794144    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794237    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="404863bf-6773-47a7-825a-e06296196bb7" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794245    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b904c3d-5de5-454d-9b4a-08ffe192048b" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794253    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="792a848c-f121-451d-9c8d-ddeae39fc71a" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794261    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0e86d5a-3723-4f52-aed3-b75948b83543" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794265    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f8d7623-86bf-4e6d-9edd-3ff62c13f398" containerName="maas-api"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794271    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce14eb2-2b79-4337-8bbe-2ab0b5cca437" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794276    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e0f4157-29b4-48bb-b670-a7ffbaf55fc8" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794283    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="198506e5-5eb0-4718-be4a-d82ceff4b5f2" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794289    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="fddd76a8-a82a-4d6c-ba36-b7565617780e" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794295    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0aa1efe-c2cc-4a3b-8ffe-1e81f7e760f2" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794300    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="18cbeeb7-f070-47b5-b56f-4e53e6c01a74" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794306    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="736624fe-c7dd-4bf8-9e07-ad8ca40ba3b4" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794312    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="26fc637b-067e-4f94-a6e9-d3407eb10bc3" containerName="discovery"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794316    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e301a2-c297-45ae-a892-2d610b58cb93" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794322    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="11ca9dfb-6c91-4e9c-9335-eb71c6ba6198" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794328    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b14ccbd-0d9f-474b-8e57-dd640c6d6db4" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794336    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bb2a5ff-1708-4d84-8357-4d5c57c4e72a" containerName="maas-api"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794341    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="33cc25df-9a3e-4e27-a23b-48e586e99269" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794348    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="df16f1ae-c582-4244-ad33-06e621610839" containerName="maas-api"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794352    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="22e95bf1-07b1-4fd7-990c-6a390da6e4e1" containerName="payload-pre-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794359    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6ceeecd-8be8-4f89-a956-befef0c2b31d" containerName="payload-processing"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794366    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.795374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.794371    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fb8b9c8-d6ed-4554-8dde-5f32f5598d74" containerName="istio-proxy"
Oct 30 23:43:42.799224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.799205    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847273 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847230    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847296    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847329    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847351    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847428    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847450    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847475    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847501    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9nb\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.847937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.847564    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.885877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.885841    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:43:42.948694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.948658    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.948878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.948842    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.948938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.948882    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.948938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.948919    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949043 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.948942    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949043 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949020    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949046    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949072    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949099    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9nb\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949126    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949239    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949554    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.949705 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.949688    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.950162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.950139    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.951593 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.951571    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:42.951858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:42.951838    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:43.015747 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.015711    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9nb\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:43.016171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.016148    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-ttcv4\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:43.116806 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.116713    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:43.564179 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.564148    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:43:43.565579 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:43:43.565417    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94286c50_3d3b_49e9_a553_5bd24afffa9f.slice/crio-97d2269f0acdbd610ea1a8365069c9ae8f43404da52a352af33ee4e6af81cfc3 WatchSource:0}: Error finding container 97d2269f0acdbd610ea1a8365069c9ae8f43404da52a352af33ee4e6af81cfc3: Status 404 returned error can't find the container with id 97d2269f0acdbd610ea1a8365069c9ae8f43404da52a352af33ee4e6af81cfc3
Oct 30 23:43:43.568279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.568242    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:43.568363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.568311    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:43.568363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:43.568343    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:44.039710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.039670    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" event={"ID":"94286c50-3d3b-49e9-a553-5bd24afffa9f","Type":"ContainerStarted","Data":"b85604a412e5a1bd084f6e6ae870ea87287354d249e3a282b791a2797303bb47"}
Oct 30 23:43:44.040197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.039729    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" event={"ID":"94286c50-3d3b-49e9-a553-5bd24afffa9f","Type":"ContainerStarted","Data":"97d2269f0acdbd610ea1a8365069c9ae8f43404da52a352af33ee4e6af81cfc3"}
Oct 30 23:43:44.119133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.118986    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:44.133811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.133772    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:44.133972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.133844    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:44.162513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:44.162462    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podStartSLOduration=2.162449666 podStartE2EDuration="2.162449666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:44.158566044 +0000 UTC m=+2195.918658617" watchObservedRunningTime="2026-10-30 23:43:44.162449666 +0000 UTC m=+2195.922542265"
Oct 30 23:43:45.117687 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:45.117651    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:45.118124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:45.117716    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:46.117114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:46.117077    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:46.117307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:46.117143    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:47.117745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:47.117706    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:47.118211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:47.117766    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:48.117478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:48.117435    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:48.117724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:48.117497    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:49.117504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:49.117467    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused" start-of-body=
Oct 30 23:43:49.117945 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:49.117530    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.128:15021/healthz/ready\": dial tcp 10.134.0.128:15021: connect: connection refused"
Oct 30 23:43:50.122164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:50.122133    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:50.122657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:50.122586    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:50.123475 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:50.123457    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:43:57.918172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:57.918128    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:43:57.923532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:57.923506    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.017642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.017577    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:43:58.067947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.067917    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.067956    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068042    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068113    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068184    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068231    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068259    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068275    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86bt\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.068360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.068335    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170042    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170127 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170114    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170146    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170176    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170215    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86bt\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170322    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170543 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170511    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170565    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170574    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170677    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170693    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.170875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170854    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.171022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170923    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.171022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.170998    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.172679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.172657    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.173049 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.173026    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.227811 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.227780    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.228215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.228190    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86bt\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\") pod \"e2e-mt-55666687-openshift-default-5748f754cc-gcg5g\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") " pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.239479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.239452    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:58.695643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.691681    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:43:58.702371 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:43:58.702335    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedb6247_27aa_4706_b991_a57596d96efb.slice/crio-fb922e4b50a11f0d383210acdac175e7dfb45b5b77ec2f37d68fd49c2ce3a11d WatchSource:0}: Error finding container fb922e4b50a11f0d383210acdac175e7dfb45b5b77ec2f37d68fd49c2ce3a11d: Status 404 returned error can't find the container with id fb922e4b50a11f0d383210acdac175e7dfb45b5b77ec2f37d68fd49c2ce3a11d
Oct 30 23:43:58.705769 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.705725    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:58.705865 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.705826    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:58.705917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:58.705894    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:59.155738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.155696    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" event={"ID":"eedb6247-27aa-4706-b991-a57596d96efb","Type":"ContainerStarted","Data":"49e43957e04734401f74c87fd334233fb9d35776eb7c97a2f1ec9c7abd438417"}
Oct 30 23:43:59.156225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.155761    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" event={"ID":"eedb6247-27aa-4706-b991-a57596d96efb","Type":"ContainerStarted","Data":"fb922e4b50a11f0d383210acdac175e7dfb45b5b77ec2f37d68fd49c2ce3a11d"}
Oct 30 23:43:59.239690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.239662    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:43:59.240956 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.240935    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:43:59.241030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.240987    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:43:59.300513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:43:59.300452    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podStartSLOduration=2.300432794 podStartE2EDuration="2.300432794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:59.298846293 +0000 UTC m=+2211.058938866" watchObservedRunningTime="2026-10-30 23:43:59.300432794 +0000 UTC m=+2211.060525365"
Oct 30 23:44:00.239839 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:00.239806    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:00.240246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:00.239856    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:01.103008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.102967    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:44:01.105783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.103399    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" podUID="985470e4-b1a8-4777-b701-52fe09a7c423" containerName="maas-api" containerID="cri-o://b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223" gracePeriod=30
Oct 30 23:44:01.241979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.241947    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:01.242462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.242003    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:01.514651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.512838    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:44:01.538347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.538310    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\") pod \"985470e4-b1a8-4777-b701-52fe09a7c423\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") "
Oct 30 23:44:01.538559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.538384    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\") pod \"985470e4-b1a8-4777-b701-52fe09a7c423\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") "
Oct 30 23:44:01.538690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.538646    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") pod \"985470e4-b1a8-4777-b701-52fe09a7c423\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") "
Oct 30 23:44:01.538768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.538690    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\" (UniqueName: \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\") pod \"985470e4-b1a8-4777-b701-52fe09a7c423\" (UID: \"985470e4-b1a8-4777-b701-52fe09a7c423\") "
Oct 30 23:44:01.539573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.539063    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca" pod "985470e4-b1a8-4777-b701-52fe09a7c423" (UID: "985470e4-b1a8-4777-b701-52fe09a7c423"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:01.539573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.539298    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/985470e4-b1a8-4777-b701-52fe09a7c423-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:01.543692 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.541841    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs" pod "985470e4-b1a8-4777-b701-52fe09a7c423" (UID: "985470e4-b1a8-4777-b701-52fe09a7c423"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:01.543837 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.543799    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr" pod "985470e4-b1a8-4777-b701-52fe09a7c423" (UID: "985470e4-b1a8-4777-b701-52fe09a7c423"). InnerVolumeSpecName "kube-api-access-mrbfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:01.544076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.544055    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls" pod "985470e4-b1a8-4777-b701-52fe09a7c423" (UID: "985470e4-b1a8-4777-b701-52fe09a7c423"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:01.640798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.640709    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:01.640798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.640747    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrbfr\" (UniqueName: \"kubernetes.io/projected/985470e4-b1a8-4777-b701-52fe09a7c423-kube-api-access-mrbfr\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:01.640798 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:01.640763    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985470e4-b1a8-4777-b701-52fe09a7c423-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:02.192645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.189537    6126 generic.go:356] "Generic (PLEG): container finished" podID="985470e4-b1a8-4777-b701-52fe09a7c423" containerID="b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223" exitCode=0
Oct 30 23:44:02.192645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.189686    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" event={"ID":"985470e4-b1a8-4777-b701-52fe09a7c423","Type":"ContainerDied","Data":"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"}
Oct 30 23:44:02.192645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.189742    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg" event={"ID":"985470e4-b1a8-4777-b701-52fe09a7c423","Type":"ContainerDied","Data":"4d5c583d2346f1701e71fad4a8b415c5e4a629b4ffd45b3a6327a3adfbe45bc1"}
Oct 30 23:44:02.192645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.189770    6126 scope.go:122] "RemoveContainer" containerID="b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"
Oct 30 23:44:02.192645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.189934    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"
Oct 30 23:44:02.236158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.235853    6126 scope.go:122] "RemoveContainer" containerID="b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"
Oct 30 23:44:02.236247 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:02.236200    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223\": container with ID starting with b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223 not found: ID does not exist" containerID="b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"
Oct 30 23:44:02.236308 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.236246    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223"} err="failed to get container status \"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223\": rpc error: code = NotFound desc = could not find container \"b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223\": container with ID starting with b4fa7104b433bf9e4f88e9383dc3979dfa8cf36e08e9abd838b985653cc17223 not found: ID does not exist"
Oct 30 23:44:02.240205 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.240178    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:02.240338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.240229    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:02.326490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.326450    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:44:02.326962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.326714    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" podUID="004115cd-af54-4059-9574-7058cb8a432d" containerName="maas-api" containerID="cri-o://e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604" gracePeriod=30
Oct 30 23:44:02.385642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.383909    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:44:02.415679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.415645    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-196ff7-b66d98cb9-9xcvg"]
Oct 30 23:44:02.439495 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.439420    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="985470e4-b1a8-4777-b701-52fe09a7c423" path="/var/lib/kubelet/pods/985470e4-b1a8-4777-b701-52fe09a7c423/volumes"
Oct 30 23:44:02.764558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.763541    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:44:02.863816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.863786    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\" (UniqueName: \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\") pod \"004115cd-af54-4059-9574-7058cb8a432d\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") "
Oct 30 23:44:02.863816 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.863823    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") pod \"004115cd-af54-4059-9574-7058cb8a432d\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") "
Oct 30 23:44:02.864090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.863865    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\") pod \"004115cd-af54-4059-9574-7058cb8a432d\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") "
Oct 30 23:44:02.864090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.863890    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\") pod \"004115cd-af54-4059-9574-7058cb8a432d\" (UID: \"004115cd-af54-4059-9574-7058cb8a432d\") "
Oct 30 23:44:02.864348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.864315    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca" pod "004115cd-af54-4059-9574-7058cb8a432d" (UID: "004115cd-af54-4059-9574-7058cb8a432d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:02.864871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.864841    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/004115cd-af54-4059-9574-7058cb8a432d-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:02.866309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.866282    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls" pod "004115cd-af54-4059-9574-7058cb8a432d" (UID: "004115cd-af54-4059-9574-7058cb8a432d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:02.866309 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.866300    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs" pod "004115cd-af54-4059-9574-7058cb8a432d" (UID: "004115cd-af54-4059-9574-7058cb8a432d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:02.866433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.866350    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh" pod "004115cd-af54-4059-9574-7058cb8a432d" (UID: "004115cd-af54-4059-9574-7058cb8a432d"). InnerVolumeSpecName "kube-api-access-2glzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:02.966477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.966441    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2glzh\" (UniqueName: \"kubernetes.io/projected/004115cd-af54-4059-9574-7058cb8a432d-kube-api-access-2glzh\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:02.966477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.966472    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:02.966477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:02.966482    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/004115cd-af54-4059-9574-7058cb8a432d-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:03.241675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.241293    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:03.241675 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.241354    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:03.245114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.245087    6126 generic.go:356] "Generic (PLEG): container finished" podID="004115cd-af54-4059-9574-7058cb8a432d" containerID="e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604" exitCode=0
Oct 30 23:44:03.245297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.245146    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" event={"ID":"004115cd-af54-4059-9574-7058cb8a432d","Type":"ContainerDied","Data":"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"}
Oct 30 23:44:03.245297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.245161    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"
Oct 30 23:44:03.245297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.245191    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm" event={"ID":"004115cd-af54-4059-9574-7058cb8a432d","Type":"ContainerDied","Data":"866b8fe65754a11162e02d60dd98218baa1e6e0b22a1f7ce3b26a78102f6006e"}
Oct 30 23:44:03.245297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.245212    6126 scope.go:122] "RemoveContainer" containerID="e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"
Oct 30 23:44:03.263096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.263040    6126 scope.go:122] "RemoveContainer" containerID="e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"
Oct 30 23:44:03.263468 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:03.263445    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604\": container with ID starting with e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604 not found: ID does not exist" containerID="e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"
Oct 30 23:44:03.263556 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.263481    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604"} err="failed to get container status \"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604\": rpc error: code = NotFound desc = could not find container \"e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604\": container with ID starting with e1f9fa3f2c0d14000643cccfdd8c11e446b4e061be053a4f5070482e09eed604 not found: ID does not exist"
Oct 30 23:44:03.441749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.441712    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:44:03.459837 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:03.459773    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7a42d8-66857c654d-9jhdm"]
Oct 30 23:44:04.152604 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:04.152569    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:44:04.240366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:04.240334    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:04.240582 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:04.240393    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:04.419680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:04.419570    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="004115cd-af54-4059-9574-7058cb8a432d" path="/var/lib/kubelet/pods/004115cd-af54-4059-9574-7058cb8a432d/volumes"
Oct 30 23:44:05.239950 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:05.239915    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:44:05.240434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:05.239973    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.129:15021/healthz/ready\": dial tcp 10.134.0.129:15021: connect: connection refused"
Oct 30 23:44:06.245246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:06.245218    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:44:06.245693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:06.245652    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:44:06.246293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:06.246274    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:44:09.158977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:09.158942    6126 scope.go:122] "RemoveContainer" containerID="a6d0a17a8154a009e83e5e1c49b694a68bf667bda4cbb2e6ede0a7f446662209"
Oct 30 23:44:14.017501 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.017442    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:44:14.027679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.018543    6126 cpu_manager.go:414] "containerMap: removing container" podUID="985470e4-b1a8-4777-b701-52fe09a7c423" containerName="maas-api"
Oct 30 23:44:14.039885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.039852    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="985470e4-b1a8-4777-b701-52fe09a7c423" containerName="maas-api"
Oct 30 23:44:14.040166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.040148    6126 cpu_manager.go:414] "containerMap: removing container" podUID="004115cd-af54-4059-9574-7058cb8a432d" containerName="maas-api"
Oct 30 23:44:14.040279 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.040267    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="004115cd-af54-4059-9574-7058cb8a432d" containerName="maas-api"
Oct 30 23:44:14.042784 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.040761    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="004115cd-af54-4059-9574-7058cb8a432d" containerName="maas-api"
Oct 30 23:44:14.042988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.042974    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="985470e4-b1a8-4777-b701-52fe09a7c423" containerName="maas-api"
Oct 30 23:44:14.051217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.051192    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.116121 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.116070    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127534    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127638    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127722    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127755    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127834    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127890    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.127948    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.128104    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.128469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.128173    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sktck\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.158971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.158938    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-505c1f-openshift-default-dockercfg-j6jtk\""
Oct 30 23:44:14.229041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229005    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229302    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sktck\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229444    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229552 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229498    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229555    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229582    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229667    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229712    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.229776 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.229764    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.230086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.230061    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.230284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.230256    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.230385 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.230368    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.230643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.230592    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.230925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.230900    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.232670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.232004    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.233575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.233551    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.287314 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.287235    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.287553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.287525    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sktck\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\") pod \"e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") " pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.379767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.379730    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:14.838658 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.838567    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:44:14.862589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.862537    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:14.862773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.862668    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:14.862920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:14.862897    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:15.328792 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:15.328758    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerStarted","Data":"b12d054481c728f21af5710c8d4e099c2e7e2ecbf670a2649620e162545c07e4"}
Oct 30 23:44:15.329213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:15.328823    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerStarted","Data":"f435d2655e5753c00358c029933d5e11e155faec208373b972f763fceacbe53c"}
Oct 30 23:44:15.380405 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:15.380373    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:15.386291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:15.386264    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:15.456073 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:15.456019    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podStartSLOduration=2.456004078 podStartE2EDuration="2.456004078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:15.453466408 +0000 UTC m=+2227.213558980" watchObservedRunningTime="2026-10-30 23:44:15.456004078 +0000 UTC m=+2227.216096654"
Oct 30 23:44:16.336755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:16.336721    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:16.337914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:16.337878    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:44:22.327821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.327784    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:44:22.332396 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.332372    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.435706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.435674    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-505c1f-dockercfg-54dvw\""
Oct 30 23:44:22.436077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.436006    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-505c1f\""
Oct 30 23:44:22.449306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.449271    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:44:22.450987 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.450957    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85jv\" (UniqueName: \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.451395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.451371    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.454581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.454555    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:44:22.454878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.454848    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" podUID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" containerName="maas-api" containerID="cri-o://da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145" gracePeriod=30
Oct 30 23:44:22.514010 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.513979    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:44:22.521457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.521434    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.552867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.552830    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85jv\" (UniqueName: \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.553281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.553255    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.554077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.554049    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.572407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.572374    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:44:22.611576 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.611510    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85jv\" (UniqueName: \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\") pod \"payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") " pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.655715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.655670    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.655972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.655950    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c258t\" (UniqueName: \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.739391 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.739106    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:22.757726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.757682    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.757848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.757822    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c258t\" (UniqueName: \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.758982 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.758926    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.811908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.809607    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:44:22.821570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.821536    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c258t\" (UniqueName: \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\") pod \"payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.874753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.871437    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\") pod \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") "
Oct 30 23:44:22.874753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.871580    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\") pod \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") "
Oct 30 23:44:22.874753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.871747    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\") pod \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") "
Oct 30 23:44:22.874753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.871786    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\" (UniqueName: \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\") pod \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\" (UID: \"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927\") "
Oct 30 23:44:22.874753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.873645    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca" pod "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" (UID: "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:22.891013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.890955    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls" pod "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" (UID: "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:22.893222 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.893152    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9" pod "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" (UID: "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927"). InnerVolumeSpecName "kube-api-access-wg8h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:22.896755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.896707    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs" pod "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" (UID: "cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:22.900125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.898693    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:22.973519 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.973486    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:22.973519 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.973516    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:22.973777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.973527    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:22.973777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:22.973536    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg8h9\" (UniqueName: \"kubernetes.io/projected/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927-kube-api-access-wg8h9\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:23.137565 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.137479    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:44:23.291533 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.291498    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:44:23.423959 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.423867    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" event={"ID":"f501679e-9b5d-497f-a4bf-90fe5fea294f","Type":"ContainerStarted","Data":"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"}
Oct 30 23:44:23.423959 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.423918    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" event={"ID":"f501679e-9b5d-497f-a4bf-90fe5fea294f","Type":"ContainerStarted","Data":"1e1ec9b432f1ec9b368160e2e5e86a982673f2a32991923f048361a0aa84f4b5"}
Oct 30 23:44:23.424498 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.423960    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:23.425793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.425765    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" event={"ID":"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff","Type":"ContainerStarted","Data":"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"}
Oct 30 23:44:23.425940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.425807    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" event={"ID":"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff","Type":"ContainerStarted","Data":"f65d555de4c6db33a84639d3234083b2a31e2e598b70d2c746a5faca9110830e"}
Oct 30 23:44:23.425940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.425926    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:23.427159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.427135    6126 generic.go:356] "Generic (PLEG): container finished" podID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" containerID="da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145" exitCode=0
Oct 30 23:44:23.427268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.427164    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"
Oct 30 23:44:23.427268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.427178    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" event={"ID":"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927","Type":"ContainerDied","Data":"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"}
Oct 30 23:44:23.427268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.427219    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn" event={"ID":"cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927","Type":"ContainerDied","Data":"1a813dde4ccf02a92981c52529850bb8d56be677c59834c7f6511bab96bca07a"}
Oct 30 23:44:23.427268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.427247    6126 scope.go:122] "RemoveContainer" containerID="da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"
Oct 30 23:44:23.438580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.438564    6126 scope.go:122] "RemoveContainer" containerID="da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"
Oct 30 23:44:23.438902 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:23.438881    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145\": container with ID starting with da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145 not found: ID does not exist" containerID="da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"
Oct 30 23:44:23.438964 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.438910    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145"} err="failed to get container status \"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145\": rpc error: code = NotFound desc = could not find container \"da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145\": container with ID starting with da897653b6a8167fe757b7230b2bcf5f8b261e519e3d8582025627b3ac05f145 not found: ID does not exist"
Oct 30 23:44:23.565988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.556965    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" podStartSLOduration=1.556947821 podStartE2EDuration="1.556947821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:23.554986525 +0000 UTC m=+2235.315079097" watchObservedRunningTime="2026-10-30 23:44:23.556947821 +0000 UTC m=+2235.317040393"
Oct 30 23:44:23.671394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.671361    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:44:23.674688 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.674602    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-59d267-6854f85f8-fbvcn"]
Oct 30 23:44:23.791047 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:23.790987    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" podStartSLOduration=1.79096756 podStartE2EDuration="1.79096756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:23.788201417 +0000 UTC m=+2235.548293989" watchObservedRunningTime="2026-10-30 23:44:23.79096756 +0000 UTC m=+2235.551060131"
Oct 30 23:44:24.407167 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:24.407134    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" path="/var/lib/kubelet/pods/cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927/volumes"
Oct 30 23:44:32.807485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.807451    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:44:32.808152 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.808137    6126 cpu_manager.go:414] "containerMap: removing container" podUID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" containerName="maas-api"
Oct 30 23:44:32.808217 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.808152    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" containerName="maas-api"
Oct 30 23:44:32.808273 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.808264    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbd8cf0c-d3c3-40aa-8e79-5c269fc3e927" containerName="maas-api"
Oct 30 23:44:32.812151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.812135    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855487    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855606    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855716    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855783    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855807    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.855920    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.856013    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.856065    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjvr\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.856255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.856116    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.924022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.923928    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:44:32.952329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.930956    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5e3f9d-openshift-default-dockercfg-p8vr5\""
Oct 30 23:44:32.960112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960073    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjvr\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960133    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960211    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960264    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960304 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960291    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960332    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960357    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960481    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960580    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.960946 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.960896    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.961059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.961037    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.961307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.961286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.962461 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.962438    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.962919 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.962688    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.965331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.965304    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:32.966939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:32.966913    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:33.017990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.017951    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjvr\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:33.017990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.017977    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\") pod \"e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") " pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:33.135054 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.134964    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:33.651835 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.651805    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:44:33.653155 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:44:33.653124    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fd6fb5_9cbc_46e1_8c79_5c99eebb423e.slice/crio-2b7be01dc48ce8d2e34cfb96c962b9d0b2d4d20c9464dc378d51b0d5232dab89 WatchSource:0}: Error finding container 2b7be01dc48ce8d2e34cfb96c962b9d0b2d4d20c9464dc378d51b0d5232dab89: Status 404 returned error can't find the container with id 2b7be01dc48ce8d2e34cfb96c962b9d0b2d4d20c9464dc378d51b0d5232dab89
Oct 30 23:44:33.655851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.655811    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:33.655958 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.655884    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:33.655958 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.655913    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:33.858894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.858862    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:44:33.859322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:33.859082    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" containerID="cri-o://63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151" gracePeriod=30
Oct 30 23:44:34.157066 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:34.157029    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:44:34.440800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:34.440723    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:44:34.440800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:34.440785    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:44:34.513469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:34.513437    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerStarted","Data":"d796af1dace11c6efccb20156bd431ebad5376c4846522ea2e69a401bc14cb78"}
Oct 30 23:44:34.513699 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:34.513492    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerStarted","Data":"2b7be01dc48ce8d2e34cfb96c962b9d0b2d4d20c9464dc378d51b0d5232dab89"}
Oct 30 23:44:34.793722 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:34.793664    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podStartSLOduration=2.793645786 podStartE2EDuration="2.793645786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:34.790035612 +0000 UTC m=+2246.550128205" watchObservedRunningTime="2026-10-30 23:44:34.793645786 +0000 UTC m=+2246.553738357"
Oct 30 23:44:35.136114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:35.136034    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:35.142232 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:35.142206    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:35.520578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:35.520546    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:35.521758 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:35.521734    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:44:38.331250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:38.331218    6126 patch_prober.go:29] interesting pod/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:44:38.331677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:38.331275    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:44:39.145903 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.145872    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216482    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216634    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216726    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216757    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216859    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216893    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.216955    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.217056    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.217398    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.217410    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.217798    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.219977    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.220013    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\") pod \"9cd00655-86c3-4e24-abe2-e35063a95bfb\" (UID: \"9cd00655-86c3-4e24-abe2-e35063a95bfb\") "
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.220691    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.220711    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.220727    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.220741    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd00655-86c3-4e24-abe2-e35063a95bfb-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.221632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.221567    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:39.230647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.225097    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:44:39.239700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.233049    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:39.239700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.234044    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "kube-api-access-7kmzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:39.239700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.236375    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token" pod "9cd00655-86c3-4e24-abe2-e35063a95bfb" (UID: "9cd00655-86c3-4e24-abe2-e35063a95bfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:39.322096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.322058    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kmzv\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-kube-api-access-7kmzv\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.322096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.322100    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.322311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.322115    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.322311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.322129    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.322311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.322162    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd00655-86c3-4e24-abe2-e35063a95bfb-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:39.548673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.548599    6126 generic.go:356] "Generic (PLEG): container finished" podID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerID="63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151" exitCode=0
Oct 30 23:44:39.549173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.548695    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"
Oct 30 23:44:39.549173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.548699    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerDied","Data":"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"}
Oct 30 23:44:39.549173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.548772    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5" event={"ID":"9cd00655-86c3-4e24-abe2-e35063a95bfb","Type":"ContainerDied","Data":"4f9607f41159ce5c48cf76f9616bd262b39287731e19446051b2ff98a35f2320"}
Oct 30 23:44:39.549173 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.548805    6126 scope.go:122] "RemoveContainer" containerID="63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"
Oct 30 23:44:39.560197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.560166    6126 scope.go:122] "RemoveContainer" containerID="dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"
Oct 30 23:44:39.573877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.573660    6126 scope.go:122] "RemoveContainer" containerID="63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"
Oct 30 23:44:39.575157 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:39.574070    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151\": container with ID starting with 63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151 not found: ID does not exist" containerID="63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"
Oct 30 23:44:39.575157 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.574109    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151"} err="failed to get container status \"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151\": rpc error: code = NotFound desc = could not find container \"63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151\": container with ID starting with 63788a89aec716d35f76f782ff7b93d4ef6b57fb5968a1afc4b4b33a83a88151 not found: ID does not exist"
Oct 30 23:44:39.575157 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.574131    6126 scope.go:122] "RemoveContainer" containerID="dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"
Oct 30 23:44:39.575658 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:39.575602    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0\": container with ID starting with dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0 not found: ID does not exist" containerID="dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"
Oct 30 23:44:39.575787 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.575650    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0"} err="failed to get container status \"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0\": rpc error: code = NotFound desc = could not find container \"dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0\": container with ID starting with dcda0294d56ea91f7663d53f101cd94b96aa8420d63e201e4f52a921c85b54e0 not found: ID does not exist"
Oct 30 23:44:39.722215 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.722177    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:44:39.727098 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.727066    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ba13e7-openshift-default-7f47f794b9-s8jg5"]
Oct 30 23:44:39.919720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.919634    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:44:39.919909 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:39.919881    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy" containerID="cri-o://b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312" gracePeriod=30
Oct 30 23:44:40.407365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:40.407325    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" path="/var/lib/kubelet/pods/9cd00655-86c3-4e24-abe2-e35063a95bfb/volumes"
Oct 30 23:44:43.076484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.076445    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:44:43.077132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077117    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.077190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077133    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.077190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077155    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.077190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077168    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.077290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077269    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.077290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.077279    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cd00655-86c3-4e24-abe2-e35063a95bfb" containerName="istio-proxy"
Oct 30 23:44:43.082680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.082657    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.153250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.153211    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:44:43.154511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.154389    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.154754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.154734    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkb2\" (UniqueName: \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.184939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.184899    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-5e3f9d\""
Oct 30 23:44:43.185172 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.185070    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-5e3f9d-dockercfg-s5r6h\""
Oct 30 23:44:43.275577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.261806    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.275577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.261871    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkb2\" (UniqueName: \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.275577 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.265878    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.285497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.285465    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:44:43.293110 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.293084    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:44:43.293402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.293349    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.320318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.320286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkb2\" (UniqueName: \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\") pod \"payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.363393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.363306    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9sr6\" (UniqueName: \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.363393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.363388    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.398818 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.398783    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:43.464572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.464538    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.465415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.464872    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9sr6\" (UniqueName: \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.465415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.465381    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.523900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.523809    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9sr6\" (UniqueName: \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\") pod \"payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.614649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.614556    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:43.784095 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.784064    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:44:43.786526 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:44:43.786495    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3295459_5ee8_464f_a807_99229d7abeb3.slice/crio-7d50ebd4f397c622bb10f079b9f2617f31526e666176e95aeab83c03557b5699 WatchSource:0}: Error finding container 7d50ebd4f397c622bb10f079b9f2617f31526e666176e95aeab83c03557b5699: Status 404 returned error can't find the container with id 7d50ebd4f397c622bb10f079b9f2617f31526e666176e95aeab83c03557b5699
Oct 30 23:44:43.994285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:43.994257    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:44:43.995984 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:44:43.995956    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc728f89a_6114_49e1_8db2_f44e93d44f1f.slice/crio-6455ed4f43d3755893cf117cd2004f9aa831c665d5225377ce213a6b414d08c6 WatchSource:0}: Error finding container 6455ed4f43d3755893cf117cd2004f9aa831c665d5225377ce213a6b414d08c6: Status 404 returned error can't find the container with id 6455ed4f43d3755893cf117cd2004f9aa831c665d5225377ce213a6b414d08c6
Oct 30 23:44:44.597990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.597947    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" event={"ID":"c3295459-5ee8-464f-a807-99229d7abeb3","Type":"ContainerStarted","Data":"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"}
Oct 30 23:44:44.598504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.598019    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" event={"ID":"c3295459-5ee8-464f-a807-99229d7abeb3","Type":"ContainerStarted","Data":"7d50ebd4f397c622bb10f079b9f2617f31526e666176e95aeab83c03557b5699"}
Oct 30 23:44:44.598504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.598048    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:44.599838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.599813    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" event={"ID":"c728f89a-6114-49e1-8db2-f44e93d44f1f","Type":"ContainerStarted","Data":"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"}
Oct 30 23:44:44.599985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.599855    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" event={"ID":"c728f89a-6114-49e1-8db2-f44e93d44f1f","Type":"ContainerStarted","Data":"6455ed4f43d3755893cf117cd2004f9aa831c665d5225377ce213a6b414d08c6"}
Oct 30 23:44:44.599985 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.599974    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:44.715879 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.715810    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" podStartSLOduration=1.715793393 podStartE2EDuration="1.715793393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:44.712998174 +0000 UTC m=+2256.473090745" watchObservedRunningTime="2026-10-30 23:44:44.715793393 +0000 UTC m=+2256.475885964"
Oct 30 23:44:44.829786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:44.829726    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" podStartSLOduration=1.82970809 podStartE2EDuration="1.82970809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:44.829073239 +0000 UTC m=+2256.589165811" watchObservedRunningTime="2026-10-30 23:44:44.82970809 +0000 UTC m=+2256.589800662"
Oct 30 23:44:45.221132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.221107    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.290947    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291003    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291044    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291174    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291215    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291278    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291329    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291363    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.291569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\") pod \"7fe8ee21-259a-40af-afe7-c0833ba8692e\" (UID: \"7fe8ee21-259a-40af-afe7-c0833ba8692e\") "
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.292691    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.294170    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:45.296750 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.295755    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:45.309642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.297777    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:45.309642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.298194    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:45.325943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.322762    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:45.359646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.344453    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:45.359646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.344585    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:44:45.360097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.360031    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd" pod "7fe8ee21-259a-40af-afe7-c0833ba8692e" (UID: "7fe8ee21-259a-40af-afe7-c0833ba8692e"). InnerVolumeSpecName "kube-api-access-s77gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:45.394329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394298    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fe8ee21-259a-40af-afe7-c0833ba8692e-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394332    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394344    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394356    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394369    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394381    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394393    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s77gd\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-kube-api-access-s77gd\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394405    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.394555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.394417    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fe8ee21-259a-40af-afe7-c0833ba8692e-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:44:45.598591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.598546    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:44:45.599603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599582    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.599697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599606    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.599697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599650    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.599697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599660    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.599851 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599842    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.599907 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.599854    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerName="istio-proxy"
Oct 30 23:44:45.605277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.605253    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.608516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.608490    6126 generic.go:356] "Generic (PLEG): container finished" podID="7fe8ee21-259a-40af-afe7-c0833ba8692e" containerID="b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312" exitCode=0
Oct 30 23:44:45.608693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.608575    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerDied","Data":"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"}
Oct 30 23:44:45.608693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.608604    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"
Oct 30 23:44:45.608693 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.608676    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj" event={"ID":"7fe8ee21-259a-40af-afe7-c0833ba8692e","Type":"ContainerDied","Data":"c02132196fef849a7ab0146b44556971b6fd629d7185996ac445789ec6a00143"}
Oct 30 23:44:45.608874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.608712    6126 scope.go:122] "RemoveContainer" containerID="b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"
Oct 30 23:44:45.622905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.622881    6126 scope.go:122] "RemoveContainer" containerID="a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"
Oct 30 23:44:45.633070 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.633054    6126 scope.go:122] "RemoveContainer" containerID="b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"
Oct 30 23:44:45.633348 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:45.633329    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312\": container with ID starting with b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312 not found: ID does not exist" containerID="b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"
Oct 30 23:44:45.633402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.633360    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312"} err="failed to get container status \"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312\": rpc error: code = NotFound desc = could not find container \"b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312\": container with ID starting with b2664f8fa1cb3847a785d3e9869586ddf8ffd2620582c36ad4c61b92bb034312 not found: ID does not exist"
Oct 30 23:44:45.633402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.633377    6126 scope.go:122] "RemoveContainer" containerID="a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"
Oct 30 23:44:45.633667 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:44:45.633648    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9\": container with ID starting with a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9 not found: ID does not exist" containerID="a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"
Oct 30 23:44:45.633721 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.633672    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9"} err="failed to get container status \"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9\": rpc error: code = NotFound desc = could not find container \"a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9\": container with ID starting with a23e5508705885cfb2aabd80b8575ee1eaa8448a3daca0038f35cd1aa511c2e9 not found: ID does not exist"
Oct 30 23:44:45.658456 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.658428    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:44:45.659335 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.659099    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-71a68a\""
Oct 30 23:44:45.659335 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.659253    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-71a68a-dockercfg-7kpsf\""
Oct 30 23:44:45.726639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.721898    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.726639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.722003    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsm9h\" (UniqueName: \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.766231 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.763259    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:44:45.769486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.769460    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.818965 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.818916    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:44:45.823123 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.823083    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frgpq\" (UniqueName: \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.823367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.823298    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.823451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.823389    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsm9h\" (UniqueName: \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.823528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.823504    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.824546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.824521    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.858088 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.857673    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:44:45.861429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.861400    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-59d267-openshift-default-5b776654f9-zzmzj"]
Oct 30 23:44:45.883080 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.883040    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsm9h\" (UniqueName: \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\") pod \"payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.925294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.925254    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.925472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.925418    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frgpq\" (UniqueName: \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.925678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.925660    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:45.926484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.926461    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:45.985218 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:45.985181    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frgpq\" (UniqueName: \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\") pod \"payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") " pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:46.088587 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.088548    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:46.318094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.318063    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:44:46.319789 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:44:46.319764    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2365e7_d9ec_4cb7_bda2_4544eab4eff9.slice/crio-1624065826ae565f6a231d73386325689716a6f549d8c20a55233bd156ce70ac WatchSource:0}: Error finding container 1624065826ae565f6a231d73386325689716a6f549d8c20a55233bd156ce70ac: Status 404 returned error can't find the container with id 1624065826ae565f6a231d73386325689716a6f549d8c20a55233bd156ce70ac
Oct 30 23:44:46.409756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.409726    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7fe8ee21-259a-40af-afe7-c0833ba8692e" path="/var/lib/kubelet/pods/7fe8ee21-259a-40af-afe7-c0833ba8692e/volumes"
Oct 30 23:44:46.481483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.481457    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:44:46.483853 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:44:46.483827    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926b8755_3dff_427f_bd1c_6daf594a4232.slice/crio-eea34f7c1c273f1d122149244ea6e25381a5f30290ddb970684a1b7e8a70eb26 WatchSource:0}: Error finding container eea34f7c1c273f1d122149244ea6e25381a5f30290ddb970684a1b7e8a70eb26: Status 404 returned error can't find the container with id eea34f7c1c273f1d122149244ea6e25381a5f30290ddb970684a1b7e8a70eb26
Oct 30 23:44:46.621484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.621449    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" event={"ID":"926b8755-3dff-427f-bd1c-6daf594a4232","Type":"ContainerStarted","Data":"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"}
Oct 30 23:44:46.622025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.621509    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" event={"ID":"926b8755-3dff-427f-bd1c-6daf594a4232","Type":"ContainerStarted","Data":"eea34f7c1c273f1d122149244ea6e25381a5f30290ddb970684a1b7e8a70eb26"}
Oct 30 23:44:46.622025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.621572    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:46.623330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.623266    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" event={"ID":"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9","Type":"ContainerStarted","Data":"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"}
Oct 30 23:44:46.623330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.623306    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" event={"ID":"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9","Type":"ContainerStarted","Data":"1624065826ae565f6a231d73386325689716a6f549d8c20a55233bd156ce70ac"}
Oct 30 23:44:46.623486 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.623396    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:44:46.737794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.737361    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" podStartSLOduration=1.737343909 podStartE2EDuration="1.737343909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:46.736852945 +0000 UTC m=+2258.496945517" watchObservedRunningTime="2026-10-30 23:44:46.737343909 +0000 UTC m=+2258.497436481"
Oct 30 23:44:46.855354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:46.854812    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" podStartSLOduration=1.854792411 podStartE2EDuration="1.854792411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:46.85447344 +0000 UTC m=+2258.614566010" watchObservedRunningTime="2026-10-30 23:44:46.854792411 +0000 UTC m=+2258.614884984"
Oct 30 23:44:55.611767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:55.611737    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:44:55.612136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:55.611912    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:44:57.638156 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:57.638121    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:44:57.638756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:44:57.638203    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:45:00.200855 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.200815    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:00.205962 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.205934    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.275277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.275240    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:00.306992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.306942    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rckn\" (UniqueName: \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.307207 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.307131    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.325704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.325669    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5zfhp\""
Oct 30 23:45:00.408477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.408447    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.408672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.408583    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rckn\" (UniqueName: \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.409324 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.409300    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.467303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.467276    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rckn\" (UniqueName: \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\") pod \"maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.523246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.523205    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:00.910822 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.910798    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:00.912192 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:45:00.912164    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f13aed_df01_4561_bf44_2d2614c19846.slice/crio-80e86bd60671a0f77bec96200816fad67b8116c864f7e31cfdd7a24cd3f54b09 WatchSource:0}: Error finding container 80e86bd60671a0f77bec96200816fad67b8116c864f7e31cfdd7a24cd3f54b09: Status 404 returned error can't find the container with id 80e86bd60671a0f77bec96200816fad67b8116c864f7e31cfdd7a24cd3f54b09
Oct 30 23:45:00.914260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:00.914242    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:45:01.739695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:01.739651    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerStarted","Data":"80e86bd60671a0f77bec96200816fad67b8116c864f7e31cfdd7a24cd3f54b09"}
Oct 30 23:45:04.159416 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:04.159360    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:45:05.066502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:05.066464    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:45:05.775446 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:05.775357    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerStarted","Data":"8b8f36626ffc937b0c16c517b583636c8f909752bed52b08b84c3249fa05c15b"}
Oct 30 23:45:05.893022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:05.892959    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" podStartSLOduration=1.732582694 podStartE2EDuration="5.892936805s" totalImagesPullingTime="4.160354111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:05.890972417 +0000 UTC m=+2277.651064987" watchObservedRunningTime="2026-10-30 23:45:05.892936805 +0000 UTC m=+2277.653029377"
Oct 30 23:45:06.783464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:06.783427    6126 generic.go:356] "Generic (PLEG): container finished" podID="56f13aed-df01-4561-bf44-2d2614c19846" containerID="8b8f36626ffc937b0c16c517b583636c8f909752bed52b08b84c3249fa05c15b" exitCode=60
Oct 30 23:45:06.784001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:06.783510    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerDied","Data":"8b8f36626ffc937b0c16c517b583636c8f909752bed52b08b84c3249fa05c15b"}
Oct 30 23:45:06.784001 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:06.783841    6126 scope.go:122] "RemoveContainer" containerID="8b8f36626ffc937b0c16c517b583636c8f909752bed52b08b84c3249fa05c15b"
Oct 30 23:45:07.793996 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:07.793963    6126 generic.go:356] "Generic (PLEG): container finished" podID="56f13aed-df01-4561-bf44-2d2614c19846" containerID="3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540" exitCode=60
Oct 30 23:45:07.794476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:07.794050    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerDied","Data":"3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540"}
Oct 30 23:45:07.794476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:07.794113    6126 scope.go:122] "RemoveContainer" containerID="8b8f36626ffc937b0c16c517b583636c8f909752bed52b08b84c3249fa05c15b"
Oct 30 23:45:07.794476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:07.794422    6126 scope.go:122] "RemoveContainer" containerID="3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540"
Oct 30 23:45:07.794836 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:07.794812    6126 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k_odh-ai-gateway-infra(56f13aed-df01-4561-bf44-2d2614c19846)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" podUID="56f13aed-df01-4561-bf44-2d2614c19846"
Oct 30 23:45:08.831229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:08.831201    6126 scope.go:122] "RemoveContainer" containerID="3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540"
Oct 30 23:45:08.831675 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:08.831602    6126 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k_odh-ai-gateway-infra(56f13aed-df01-4561-bf44-2d2614c19846)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" podUID="56f13aed-df01-4561-bf44-2d2614c19846"
Oct 30 23:45:19.328220 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.328180    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:45:19.335999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.335971    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.390760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.390722    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:45:19.398713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.398589    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kg6f\" (UniqueName: \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.398713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.398688    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.398983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.398748    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.398983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.398961    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.436848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.436814    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-505c1f-serving-cert\""
Oct 30 23:45:19.500657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.500603    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.500862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.500687    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.500862 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:19.500822    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-serving-cert: secret "maas-api-e2e-api-a-505c1f-serving-cert" not found
Oct 30 23:45:19.500979 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.500867    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.500979 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:19.500891    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls podName:aeb3d803-cdbf-417b-a271-1436100d7544 nodeName:}" failed. No retries permitted until 2026-10-30 23:45:20.000873574 +0000 UTC m=+2291.760966126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls") pod "maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" (UID: "aeb3d803-cdbf-417b-a271-1436100d7544") : secret "maas-api-e2e-api-a-505c1f-serving-cert" not found
Oct 30 23:45:19.501098 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.500987    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kg6f\" (UniqueName: \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.501489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.501468    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.503496 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.503477    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:19.560548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:19.560512    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kg6f\" (UniqueName: \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:20.007871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.007834    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:20.010647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.010581    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") pod \"maas-api-e2e-api-a-505c1f-74687675f5-vkh6b\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:20.089331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.089258    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerName="main" containerID="cri-o://f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd" gracePeriod=45
Oct 30 23:45:20.252861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.252823    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:20.390657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.390588    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:45:20.400414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.400173    6126 scope.go:122] "RemoveContainer" containerID="3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540"
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414584    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\" (UniqueName: \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414646    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414739    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414777    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414822    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\" (UniqueName: \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.414933    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415011    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\") pod \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\" (UID: \"d025dcce-36ff-4fce-83cf-b1aeb47cc260\") "
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415087    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415348    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415515    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415532    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.415569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.415545    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.417506 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.417482    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:45:20.418123 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.418095    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "kube-api-access-2wfz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:20.418802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.418768    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm" pod "d025dcce-36ff-4fce-83cf-b1aeb47cc260" (UID: "d025dcce-36ff-4fce-83cf-b1aeb47cc260"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:20.518067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.518020    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d025dcce-36ff-4fce-83cf-b1aeb47cc260-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.518243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.518173    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d025dcce-36ff-4fce-83cf-b1aeb47cc260-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.518243 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.518197    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wfz7\" (UniqueName: \"kubernetes.io/projected/d025dcce-36ff-4fce-83cf-b1aeb47cc260-kube-api-access-2wfz7\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.665976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.665945    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:45:20.667519 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:45:20.667489    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb3d803_cdbf_417b_a271_1436100d7544.slice/crio-1d81c4eacc9d9d5538d9d9612188adde42d6865b668b58e4b5a95af62debb264 WatchSource:0}: Error finding container 1d81c4eacc9d9d5538d9d9612188adde42d6865b668b58e4b5a95af62debb264: Status 404 returned error can't find the container with id 1d81c4eacc9d9d5538d9d9612188adde42d6865b668b58e4b5a95af62debb264
Oct 30 23:45:20.917363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.917273    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerStarted","Data":"090a1668fe7692b5b325addb1ae8684000c877c4721d5846067db1a2ffab305d"}
Oct 30 23:45:20.918930 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.918899    6126 generic.go:356] "Generic (PLEG): container finished" podID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerID="f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd" exitCode=0
Oct 30 23:45:20.919075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.918936    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"
Oct 30 23:45:20.919075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.918970    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" event={"ID":"d025dcce-36ff-4fce-83cf-b1aeb47cc260","Type":"ContainerDied","Data":"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"}
Oct 30 23:45:20.919075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.919007    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" event={"ID":"d025dcce-36ff-4fce-83cf-b1aeb47cc260","Type":"ContainerDied","Data":"e9cbf242e0e009aa673f1287523237e9a3bacbd9d58124d3b4c68bab33f974d6"}
Oct 30 23:45:20.919075 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.919024    6126 scope.go:122] "RemoveContainer" containerID="f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"
Oct 30 23:45:20.920444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.920417    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" event={"ID":"aeb3d803-cdbf-417b-a271-1436100d7544","Type":"ContainerStarted","Data":"1d81c4eacc9d9d5538d9d9612188adde42d6865b668b58e4b5a95af62debb264"}
Oct 30 23:45:20.930402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.930382    6126 scope.go:122] "RemoveContainer" containerID="f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"
Oct 30 23:45:20.931009 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:20.930978    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd\": container with ID starting with f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd not found: ID does not exist" containerID="f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"
Oct 30 23:45:20.931134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:20.931019    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd"} err="failed to get container status \"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd\": rpc error: code = NotFound desc = could not find container \"f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd\": container with ID starting with f40d7e8a29c450c0aef1b137cda71eb700ca2acb41964e82c4332aa80a24facd not found: ID does not exist"
Oct 30 23:45:21.147677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.147631    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:45:21.154200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.154174    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l"]
Oct 30 23:45:21.333098 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.333060    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-55666687/e2e-lifecycle-model-55666687-kserve-64455b7997-5b95l" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerName="main" probeResult="failure" output="Get \"https://10.134.0.108:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:45:21.932491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.932405    6126 generic.go:356] "Generic (PLEG): container finished" podID="56f13aed-df01-4561-bf44-2d2614c19846" containerID="090a1668fe7692b5b325addb1ae8684000c877c4721d5846067db1a2ffab305d" exitCode=60
Oct 30 23:45:21.932491 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.932478    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerDied","Data":"090a1668fe7692b5b325addb1ae8684000c877c4721d5846067db1a2ffab305d"}
Oct 30 23:45:21.933093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.932542    6126 scope.go:122] "RemoveContainer" containerID="3ab042de7eef3c89ff816295cc667879a9c4caea5f2cbc40ecd73bb7e668b540"
Oct 30 23:45:21.933093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.932994    6126 scope.go:122] "RemoveContainer" containerID="090a1668fe7692b5b325addb1ae8684000c877c4721d5846067db1a2ffab305d"
Oct 30 23:45:21.933455 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:21.933423    6126 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k_odh-ai-gateway-infra(56f13aed-df01-4561-bf44-2d2614c19846)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" podUID="56f13aed-df01-4561-bf44-2d2614c19846"
Oct 30 23:45:21.936041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.936013    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" event={"ID":"aeb3d803-cdbf-417b-a271-1436100d7544","Type":"ContainerStarted","Data":"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"}
Oct 30 23:45:21.936162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:21.936073    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:22.043873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:22.043840    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:22.202373 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:22.202268    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" podStartSLOduration=2.368658349 podStartE2EDuration="3.202246766s" totalImagesPullingTime="833.588417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:22.198984463 +0000 UTC m=+2293.959077039" watchObservedRunningTime="2026-10-30 23:45:22.202246766 +0000 UTC m=+2293.962339339"
Oct 30 23:45:22.409248 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:22.409213    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" path="/var/lib/kubelet/pods/d025dcce-36ff-4fce-83cf-b1aeb47cc260/volumes"
Oct 30 23:45:23.164983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.164954    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:23.282124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.282071    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\") pod \"56f13aed-df01-4561-bf44-2d2614c19846\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") "
Oct 30 23:45:23.282124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.282127    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\" (UniqueName: \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\") pod \"56f13aed-df01-4561-bf44-2d2614c19846\" (UID: \"56f13aed-df01-4561-bf44-2d2614c19846\") "
Oct 30 23:45:23.283511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.283469    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca" pod "56f13aed-df01-4561-bf44-2d2614c19846" (UID: "56f13aed-df01-4561-bf44-2d2614c19846"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:23.292884 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.290188    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn" pod "56f13aed-df01-4561-bf44-2d2614c19846" (UID: "56f13aed-df01-4561-bf44-2d2614c19846"). InnerVolumeSpecName "kube-api-access-4rckn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:23.383668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.383636    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f13aed-df01-4561-bf44-2d2614c19846-maas-api-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:23.383668 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.383665    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rckn\" (UniqueName: \"kubernetes.io/projected/56f13aed-df01-4561-bf44-2d2614c19846-kube-api-access-4rckn\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:45:23.959064 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.959032    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"
Oct 30 23:45:23.959253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.959074    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k" event={"ID":"56f13aed-df01-4561-bf44-2d2614c19846","Type":"ContainerDied","Data":"80e86bd60671a0f77bec96200816fad67b8116c864f7e31cfdd7a24cd3f54b09"}
Oct 30 23:45:23.959253 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:23.959138    6126 scope.go:122] "RemoveContainer" containerID="090a1668fe7692b5b325addb1ae8684000c877c4721d5846067db1a2ffab305d"
Oct 30 23:45:24.130973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:24.130939    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:24.135293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:24.135268    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-989a4f-29890065-jm64k"]
Oct 30 23:45:24.422650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:24.422598    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56f13aed-df01-4561-bf44-2d2614c19846" path="/var/lib/kubelet/pods/56f13aed-df01-4561-bf44-2d2614c19846/volumes"
Oct 30 23:45:27.955755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:27.955723    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:45:30.927627 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.927580    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:45:30.928386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928367    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerName="main"
Oct 30 23:45:30.928386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928385    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerName="main"
Oct 30 23:45:30.928386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928399    6126 cpu_manager.go:414] "containerMap: removing container" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928404    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928412    6126 cpu_manager.go:414] "containerMap: removing container" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928417    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928529    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928543    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d025dcce-36ff-4fce-83cf-b1aeb47cc260" containerName="main"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928549    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.928558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.928555    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:30.932171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:30.932143    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.020689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.020653    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.020873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.020698    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.020873 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.020825    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97zbf\" (UniqueName: \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.020968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.020936    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.036733 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.036702    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5e3f9d-serving-cert\""
Oct 30 23:45:31.039889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.039866    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:45:31.123104 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.123071    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.123104 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.123106    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.123331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.123162    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97zbf\" (UniqueName: \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.123331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.123250    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.123331 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:31.123258    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-serving-cert: secret "maas-api-e2e-inf-a-5e3f9d-serving-cert" not found
Oct 30 23:45:31.123331 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:31.123330    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls podName:bbdf5820-be89-45ae-9b8d-47b2f8bfde53 nodeName:}" failed. No retries permitted until 2026-10-30 23:45:31.623309563 +0000 UTC m=+2303.383402113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls") pod "maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" (UID: "bbdf5820-be89-45ae-9b8d-47b2f8bfde53") : secret "maas-api-e2e-inf-a-5e3f9d-serving-cert" not found
Oct 30 23:45:31.123999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.123976    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.125861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.125842    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.182321 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.182231    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97zbf\" (UniqueName: \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.636451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.636412    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.639108 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.639085    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") pod \"maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:31.847368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:31.847325    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:32.230352 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:32.230284    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:45:32.236657 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:45:32.236626    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdf5820_be89_45ae_9b8d_47b2f8bfde53.slice/crio-bfa18979fc65c2387f142f54a509dc3737ba571b4dc63d7f53efd6d991c34fd9 WatchSource:0}: Error finding container bfa18979fc65c2387f142f54a509dc3737ba571b4dc63d7f53efd6d991c34fd9: Status 404 returned error can't find the container with id bfa18979fc65c2387f142f54a509dc3737ba571b4dc63d7f53efd6d991c34fd9
Oct 30 23:45:33.072270 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:33.072230    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" event={"ID":"bbdf5820-be89-45ae-9b8d-47b2f8bfde53","Type":"ContainerStarted","Data":"bfa18979fc65c2387f142f54a509dc3737ba571b4dc63d7f53efd6d991c34fd9"}
Oct 30 23:45:34.080941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:34.080898    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" event={"ID":"bbdf5820-be89-45ae-9b8d-47b2f8bfde53","Type":"ContainerStarted","Data":"93ed885b0bffc66a8b340660fc39dac7d5c417fa4e73b24bc1678e1308451722"}
Oct 30 23:45:34.081366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:34.081145    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:34.153249 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:45:34.153215    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:45:34.200176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:34.200125    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" podStartSLOduration=3.245317417 podStartE2EDuration="4.200111512s" totalImagesPullingTime="954.794095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:34.196604119 +0000 UTC m=+2305.956696690" watchObservedRunningTime="2026-10-30 23:45:34.200111512 +0000 UTC m=+2305.960204083"
Oct 30 23:45:40.095565 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:40.095530    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:45:41.038783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.038751    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:45:41.039536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.039516    6126 cpu_manager.go:414] "containerMap: removing container" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:41.039670 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.039538    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f13aed-df01-4561-bf44-2d2614c19846" containerName="cleanup"
Oct 30 23:45:41.047432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.047409    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.100554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.100520    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:45:41.113809 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.113764    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-71a68a-serving-cert\""
Oct 30 23:45:41.172870 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.172838    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.173078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.172983    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.173078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.173026    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.173341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.173315    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29n5\" (UniqueName: \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.274636 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.274595    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29n5\" (UniqueName: \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.274829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.274682    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.274905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.274837    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.274963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.274914    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.275576 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.275542    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.277116 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.277096    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.277360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.277340    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.332737 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.332660    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29n5\" (UniqueName: \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\") pod \"maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.362386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.362354    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:41.743902 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:41.743876    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:45:41.745250 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:45:41.745218    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcd11cc_7a60_465d_8c5a_5a27ecf43600.slice/crio-559107de904831bc679b2fc2523812b57fec5e6f711fac1933685897d1add77f WatchSource:0}: Error finding container 559107de904831bc679b2fc2523812b57fec5e6f711fac1933685897d1add77f: Status 404 returned error can't find the container with id 559107de904831bc679b2fc2523812b57fec5e6f711fac1933685897d1add77f
Oct 30 23:45:42.146929 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:42.146846    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" event={"ID":"2bcd11cc-7a60-465d-8c5a-5a27ecf43600","Type":"ContainerStarted","Data":"559107de904831bc679b2fc2523812b57fec5e6f711fac1933685897d1add77f"}
Oct 30 23:45:43.160710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:43.160674    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" event={"ID":"2bcd11cc-7a60-465d-8c5a-5a27ecf43600","Type":"ContainerStarted","Data":"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"}
Oct 30 23:45:43.161136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:43.160747    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:43.286082 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:43.280485    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" podStartSLOduration=2.434675999 podStartE2EDuration="3.280467205s" totalImagesPullingTime="845.791206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:43.277394807 +0000 UTC m=+2315.037487378" watchObservedRunningTime="2026-10-30 23:45:43.280467205 +0000 UTC m=+2315.040559777"
Oct 30 23:45:49.177867 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:49.176724    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:45:55.357834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.357803    6126 generic.go:356] "Generic (PLEG): container finished" podID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerID="d796af1dace11c6efccb20156bd431ebad5376c4846522ea2e69a401bc14cb78" exitCode=0
Oct 30 23:45:55.358234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.357873    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerDied","Data":"d796af1dace11c6efccb20156bd431ebad5376c4846522ea2e69a401bc14cb78"}
Oct 30 23:45:55.358301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.358283    6126 scope.go:122] "RemoveContainer" containerID="d796af1dace11c6efccb20156bd431ebad5376c4846522ea2e69a401bc14cb78"
Oct 30 23:45:55.359878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.359851    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:55.359937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.359921    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:55.359972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:55.359953    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:56.366439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.366408    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerStarted","Data":"d65993d47f94b698177a33e5f4f9cde8856217a5f743496ab171c2825e8c386f"}
Oct 30 23:45:56.368131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.368106    6126 generic.go:356] "Generic (PLEG): container finished" podID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerID="b12d054481c728f21af5710c8d4e099c2e7e2ecbf670a2649620e162545c07e4" exitCode=0
Oct 30 23:45:56.368278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.368181    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerDied","Data":"b12d054481c728f21af5710c8d4e099c2e7e2ecbf670a2649620e162545c07e4"}
Oct 30 23:45:56.368546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.368529    6126 scope.go:122] "RemoveContainer" containerID="b12d054481c728f21af5710c8d4e099c2e7e2ecbf670a2649620e162545c07e4"
Oct 30 23:45:56.369941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.369914    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:56.370004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.369983    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:56.370042 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:56.370016    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:45:57.135787 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.135758    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:45:57.136003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.135978    6126 patch_prober.go:29] interesting pod/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 23:45:57.136083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.136051    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 23:45:57.376965 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.376931    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerStarted","Data":"5c2481f640731a2e3c48c6fae3a2019522d44fe90e8af09b93e5213697422b9d"}
Oct 30 23:45:57.388707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.388117    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:45:57.388707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.388246    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:45:57.388707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:57.388293    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:45:58.142643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:58.141903    6126 patch_prober.go:29] interesting pod/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 23:45:58.142643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:58.141993    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 23:45:58.396709 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:58.396045    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:45:58.396709 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:58.396118    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:45:59.140980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:59.140939    6126 patch_prober.go:29] interesting pod/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 23:45:59.141285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:59.141253    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 23:45:59.383803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:59.383763    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:45:59.384100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:45:59.384063    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:46:00.142388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:00.142351    6126 patch_prober.go:29] interesting pod/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 23:46:00.143051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:00.142997    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 23:46:00.400581 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:00.400487    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:46:00.400874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:00.400840    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:46:01.136657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:01.136094    6126 patch_prober.go:29] interesting pod/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 23:46:01.136657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:01.136194    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 23:46:01.345701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:01.341864    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:46:01.408706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:01.392650    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:46:01.408706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:01.392750    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:46:02.141077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:02.141048    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:46:02.141473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:02.141446    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:46:02.142164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:02.142144    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:46:02.383036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:02.382998    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:46:02.383678 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:02.383609    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.130:15021/healthz/ready\": dial tcp 10.134.0.130:15021: connect: connection refused"
Oct 30 23:46:03.385407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:03.385374    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:46:03.386452 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:03.386430    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:46:04.152475 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:46:04.152437    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:46:09.248858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:09.248803    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:46:09.249662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:09.249599    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy" containerID="cri-o://601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421" gracePeriod=30
Oct 30 23:46:13.421225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.421185    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:46:13.421810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.421437    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy" containerID="cri-o://b85604a412e5a1bd084f6e6ae870ea87287354d249e3a282b791a2797303bb47" gracePeriod=30
Oct 30 23:46:13.436472 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.436436    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:46:13.436666 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.436645    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy" containerID="cri-o://49e43957e04734401f74c87fd334233fb9d35776eb7c97a2f1ec9c7abd438417" gracePeriod=30
Oct 30 23:46:13.457862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.457801    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:46:13.458040 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.458019    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" containerID="cri-o://9aca28259d6595fc706b3a255b203f90eb282969972019c6da5b55213b6e2488" gracePeriod=30
Oct 30 23:46:13.469465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.469440    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:46:13.469671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:13.469646    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" containerID="cri-o://a6803118dec5896befbe879ed1d34e165905b2e6f6947b4a280a0c4dcff7b23e" gracePeriod=30
Oct 30 23:46:14.539559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.539495    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:46:14.613322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.613286    6126 generic.go:356] "Generic (PLEG): container finished" podID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerID="601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421" exitCode=0
Oct 30 23:46:14.613534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.613340    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"
Oct 30 23:46:14.613534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.613369    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerDied","Data":"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"}
Oct 30 23:46:14.613534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.613439    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz" event={"ID":"40e6a195-f46b-4a23-9751-82da2f310bd1","Type":"ContainerDied","Data":"6b90fe4072d27cd2aee2e1e167b2a98a7a9ddad76ff3f55dc8f07a78b24bdbcf"}
Oct 30 23:46:14.613534 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.613471    6126 scope.go:122] "RemoveContainer" containerID="601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"
Oct 30 23:46:14.624224 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.624203    6126 scope.go:122] "RemoveContainer" containerID="2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"
Oct 30 23:46:14.634184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.634157    6126 scope.go:122] "RemoveContainer" containerID="601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"
Oct 30 23:46:14.634492 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:46:14.634471    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421\": container with ID starting with 601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421 not found: ID does not exist" containerID="601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"
Oct 30 23:46:14.634568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.634502    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421"} err="failed to get container status \"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421\": rpc error: code = NotFound desc = could not find container \"601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421\": container with ID starting with 601e407f3e0cee298fab9f1d518a300bd28c21c122ffa07d52add3702c87a421 not found: ID does not exist"
Oct 30 23:46:14.634568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.634521    6126 scope.go:122] "RemoveContainer" containerID="2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"
Oct 30 23:46:14.634815 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:46:14.634795    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22\": container with ID starting with 2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22 not found: ID does not exist" containerID="2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"
Oct 30 23:46:14.634888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.634827    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22"} err="failed to get container status \"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22\": rpc error: code = NotFound desc = could not find container \"2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22\": container with ID starting with 2226a961e746ca5e92d14fc7dcca88fc4c7086c2665fe3c88f5a85664c680d22 not found: ID does not exist"
Oct 30 23:46:14.645339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645315    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645404    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645434 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645428    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645514 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645493    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645564 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645538    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645722 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645701    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645739    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645783    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.645846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645791    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:14.646029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645970    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:14.647608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.645915    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\") pod \"40e6a195-f46b-4a23-9751-82da2f310bd1\" (UID: \"40e6a195-f46b-4a23-9751-82da2f310bd1\") "
Oct 30 23:46:14.647608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.646514    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:14.647608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.646701    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:14.647608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.646981    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:14.652643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.648676    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.652643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.648705    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.652643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.648720    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.652643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.648737    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.652643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.648758    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e6a195-f46b-4a23-9751-82da2f310bd1-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.660310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.660275    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "kube-api-access-lq9sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:14.660527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.660488    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:14.660792 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.660747    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:14.660792 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.660756    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy" pod "40e6a195-f46b-4a23-9751-82da2f310bd1" (UID: "40e6a195-f46b-4a23-9751-82da2f310bd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:14.750258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.750226    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.750258 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.750257    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.750485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.750268    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq9sc\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-kube-api-access-lq9sc\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:14.750485 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:14.750277    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e6a195-f46b-4a23-9751-82da2f310bd1-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:15.038914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:15.038877    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:46:15.044647 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:15.044603    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-989a4f-openshift-default-697f765b6c-sgzcz"]
Oct 30 23:46:15.969266 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:15.969232    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-84q9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:46:15.969697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:15.969300    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:46:16.408736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:16.408649    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" path="/var/lib/kubelet/pods/40e6a195-f46b-4a23-9751-82da2f310bd1/volumes"
Oct 30 23:46:16.412608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:16.412580    6126 patch_prober.go:29] interesting pod/e2e-mt-55666687-openshift-default-5748f754cc-clqt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:46:16.412782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:16.412688    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:46:18.647977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.647828    6126 generic.go:356] "Generic (PLEG): container finished" podID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerID="b85604a412e5a1bd084f6e6ae870ea87287354d249e3a282b791a2797303bb47" exitCode=0
Oct 30 23:46:18.647977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.647915    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" event={"ID":"94286c50-3d3b-49e9-a553-5bd24afffa9f","Type":"ContainerDied","Data":"b85604a412e5a1bd084f6e6ae870ea87287354d249e3a282b791a2797303bb47"}
Oct 30 23:46:18.650329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.650152    6126 generic.go:356] "Generic (PLEG): container finished" podID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerID="9aca28259d6595fc706b3a255b203f90eb282969972019c6da5b55213b6e2488" exitCode=0
Oct 30 23:46:18.650329 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.650275    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" event={"ID":"9b393ab3-1693-4e24-83cc-109dbbb88cbd","Type":"ContainerDied","Data":"9aca28259d6595fc706b3a255b203f90eb282969972019c6da5b55213b6e2488"}
Oct 30 23:46:18.652438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.652324    6126 generic.go:356] "Generic (PLEG): container finished" podID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerID="a6803118dec5896befbe879ed1d34e165905b2e6f6947b4a280a0c4dcff7b23e" exitCode=0
Oct 30 23:46:18.652438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.652389    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" event={"ID":"d3dca1ae-6cac-41ae-97a7-36b83aad481e","Type":"ContainerDied","Data":"a6803118dec5896befbe879ed1d34e165905b2e6f6947b4a280a0c4dcff7b23e"}
Oct 30 23:46:18.654305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.654203    6126 generic.go:356] "Generic (PLEG): container finished" podID="eedb6247-27aa-4706-b991-a57596d96efb" containerID="49e43957e04734401f74c87fd334233fb9d35776eb7c97a2f1ec9c7abd438417" exitCode=0
Oct 30 23:46:18.654305 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.654274    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" event={"ID":"eedb6247-27aa-4706-b991-a57596d96efb","Type":"ContainerDied","Data":"49e43957e04734401f74c87fd334233fb9d35776eb7c97a2f1ec9c7abd438417"}
Oct 30 23:46:18.798494 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.798410    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:46:18.837659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.834017    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:46:18.840120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.840087    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:46:18.865917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.865892    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:46:18.917778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917745    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917793    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917825    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917857    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917878    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917906    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.917978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.917940    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918008    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918042    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918094    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918118    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918170    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918200    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918259    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918298    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918358    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918385    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918432    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918465    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918493    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918522    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918553    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918604    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918650    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\") pod \"94286c50-3d3b-49e9-a553-5bd24afffa9f\" (UID: \"94286c50-3d3b-49e9-a553-5bd24afffa9f\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918688    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918737    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\") pod \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\" (UID: \"9b393ab3-1693-4e24-83cc-109dbbb88cbd\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918808    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.918869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.918867    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\") pod \"eedb6247-27aa-4706-b991-a57596d96efb\" (UID: \"eedb6247-27aa-4706-b991-a57596d96efb\") "
Oct 30 23:46:18.919539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919006    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.919539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919219    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.919724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919660    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:18.919724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919682    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:18.919724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919698    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:18.919917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919776    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.919917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919869    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:18.920027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.919966    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.920132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.920113    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.920132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.920122    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.920449 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.920428    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:18.920531 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.920493    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.920711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.920689    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.921543 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.921286    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.921543 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.921380    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:18.924676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924446    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.924676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924483    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:18.924676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924495    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.924676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924510    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "kube-api-access-8f9nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:18.924676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924557    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.924997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.924819    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "kube-api-access-w86bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:18.925089 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.925066    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.925278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.925249    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:18.925392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.925366    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:18.926601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.926562    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo" pod "94286c50-3d3b-49e9-a553-5bd24afffa9f" (UID: "94286c50-3d3b-49e9-a553-5bd24afffa9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:18.927187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.927162    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:18.927271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.927167    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:18.928086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.928062    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token" pod "eedb6247-27aa-4706-b991-a57596d96efb" (UID: "eedb6247-27aa-4706-b991-a57596d96efb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:18.928651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:18.928598    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs" pod "9b393ab3-1693-4e24-83cc-109dbbb88cbd" (UID: "9b393ab3-1693-4e24-83cc-109dbbb88cbd"). InnerVolumeSpecName "kube-api-access-z5drs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:19.020134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020105    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020149    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020306 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020201    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020417 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020368    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020489 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020442    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020564    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020674    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:19.020783 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020764    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020763    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:19.020850 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020819    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020896    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\") pod \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\" (UID: \"d3dca1ae-6cac-41ae-97a7-36b83aad481e\") "
Oct 30 23:46:19.020952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.020817    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:19.021140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021114    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:19.021397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021334    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:19.021720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021699    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f9nb\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-kube-api-access-8f9nb\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021727    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021741    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021755    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021769    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021783    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.021808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021797    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021812    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021827    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021841    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021858    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w86bt\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-kube-api-access-w86bt\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021873    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94286c50-3d3b-49e9-a553-5bd24afffa9f-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021887    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedb6247-27aa-4706-b991-a57596d96efb-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021901    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021915    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5drs\" (UniqueName: \"kubernetes.io/projected/9b393ab3-1693-4e24-83cc-109dbbb88cbd-kube-api-access-z5drs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021929    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021942    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021957    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021971    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94286c50-3d3b-49e9-a553-5bd24afffa9f-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021986    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94286c50-3d3b-49e9-a553-5bd24afffa9f-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.021999    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022013    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022028    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b393ab3-1693-4e24-83cc-109dbbb88cbd-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022041    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedb6247-27aa-4706-b991-a57596d96efb-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022054    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022069    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedb6247-27aa-4706-b991-a57596d96efb-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022084    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedb6247-27aa-4706-b991-a57596d96efb-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022098    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.022328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022112    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b393ab3-1693-4e24-83cc-109dbbb88cbd-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.023372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022701    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:19.023372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022799    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:19.023372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.022892    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "kube-api-access-krlxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:19.023372 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.023247    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token" pod "d3dca1ae-6cac-41ae-97a7-36b83aad481e" (UID: "d3dca1ae-6cac-41ae-97a7-36b83aad481e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:19.123641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.123583    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.123641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.123644    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.123856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.123657    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krlxs\" (UniqueName: \"kubernetes.io/projected/d3dca1ae-6cac-41ae-97a7-36b83aad481e-kube-api-access-krlxs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.123856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.123667    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3dca1ae-6cac-41ae-97a7-36b83aad481e-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:19.663205 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.663166    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"
Oct 30 23:46:19.663205 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.663189    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4" event={"ID":"94286c50-3d3b-49e9-a553-5bd24afffa9f","Type":"ContainerDied","Data":"97d2269f0acdbd610ea1a8365069c9ae8f43404da52a352af33ee4e6af81cfc3"}
Oct 30 23:46:19.663800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.663259    6126 scope.go:122] "RemoveContainer" containerID="b85604a412e5a1bd084f6e6ae870ea87287354d249e3a282b791a2797303bb47"
Oct 30 23:46:19.664917 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.664890    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w" event={"ID":"9b393ab3-1693-4e24-83cc-109dbbb88cbd","Type":"ContainerDied","Data":"de8c4f03e28856f817671d22bb288b14f95cbb045a97479a79a7ffb7efcf9698"}
Oct 30 23:46:19.665031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.664879    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"
Oct 30 23:46:19.666407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.666387    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"
Oct 30 23:46:19.666535 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.666374    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4" event={"ID":"d3dca1ae-6cac-41ae-97a7-36b83aad481e","Type":"ContainerDied","Data":"7f9f52160be8fd378a2f22f2fb712b60193d7270b40d0dfcc6c30fd8ad40c26e"}
Oct 30 23:46:19.667881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.667853    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"
Oct 30 23:46:19.667992 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.667900    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g" event={"ID":"eedb6247-27aa-4706-b991-a57596d96efb","Type":"ContainerDied","Data":"fb922e4b50a11f0d383210acdac175e7dfb45b5b77ec2f37d68fd49c2ce3a11d"}
Oct 30 23:46:19.677122 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.677104    6126 scope.go:122] "RemoveContainer" containerID="9aca28259d6595fc706b3a255b203f90eb282969972019c6da5b55213b6e2488"
Oct 30 23:46:19.688625 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.688594    6126 scope.go:122] "RemoveContainer" containerID="a6803118dec5896befbe879ed1d34e165905b2e6f6947b4a280a0c4dcff7b23e"
Oct 30 23:46:19.698541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.698519    6126 scope.go:122] "RemoveContainer" containerID="49e43957e04734401f74c87fd334233fb9d35776eb7c97a2f1ec9c7abd438417"
Oct 30 23:46:19.830402 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.830362    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:46:19.835016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.834988    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-gcg5g"]
Oct 30 23:46:19.946011 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.945979    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:46:19.950333 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:19.950304    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-clqt4"]
Oct 30 23:46:20.061037 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.060931    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:46:20.066009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.065982    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-84q9w"]
Oct 30 23:46:20.179297 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.179256    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:46:20.181963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.181940    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-55666687-openshift-default-5748f754cc-ttcv4"]
Oct 30 23:46:20.408187 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.408093    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" path="/var/lib/kubelet/pods/94286c50-3d3b-49e9-a553-5bd24afffa9f/volumes"
Oct 30 23:46:20.408715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.408695    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" path="/var/lib/kubelet/pods/9b393ab3-1693-4e24-83cc-109dbbb88cbd/volumes"
Oct 30 23:46:20.409219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.409200    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" path="/var/lib/kubelet/pods/d3dca1ae-6cac-41ae-97a7-36b83aad481e/volumes"
Oct 30 23:46:20.410058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:20.410031    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eedb6247-27aa-4706-b991-a57596d96efb" path="/var/lib/kubelet/pods/eedb6247-27aa-4706-b991-a57596d96efb/volumes"
Oct 30 23:46:30.736197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:30.736157    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:46:30.736673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:30.736368    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" podUID="532ac912-3fb8-47b8-b23f-3451c284295c" containerName="maas-api" containerID="cri-o://fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb" gracePeriod=30
Oct 30 23:46:31.028800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.028768    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:46:31.082422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.082395    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\") pod \"532ac912-3fb8-47b8-b23f-3451c284295c\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") "
Oct 30 23:46:31.082649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.082467    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\" (UniqueName: \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\") pod \"532ac912-3fb8-47b8-b23f-3451c284295c\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") "
Oct 30 23:46:31.082649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.082493    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") pod \"532ac912-3fb8-47b8-b23f-3451c284295c\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") "
Oct 30 23:46:31.082752 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.082686    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\") pod \"532ac912-3fb8-47b8-b23f-3451c284295c\" (UID: \"532ac912-3fb8-47b8-b23f-3451c284295c\") "
Oct 30 23:46:31.082799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.082785    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca" pod "532ac912-3fb8-47b8-b23f-3451c284295c" (UID: "532ac912-3fb8-47b8-b23f-3451c284295c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:31.083284 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.083184    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/532ac912-3fb8-47b8-b23f-3451c284295c-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:31.084963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.084925    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h" pod "532ac912-3fb8-47b8-b23f-3451c284295c" (UID: "532ac912-3fb8-47b8-b23f-3451c284295c"). InnerVolumeSpecName "kube-api-access-lbl4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:31.085069 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.085010    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs" pod "532ac912-3fb8-47b8-b23f-3451c284295c" (UID: "532ac912-3fb8-47b8-b23f-3451c284295c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:46:31.085069 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.085047    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls" pod "532ac912-3fb8-47b8-b23f-3451c284295c" (UID: "532ac912-3fb8-47b8-b23f-3451c284295c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:46:31.185029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.184997    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:31.185029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.185028    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbl4h\" (UniqueName: \"kubernetes.io/projected/532ac912-3fb8-47b8-b23f-3451c284295c-kube-api-access-lbl4h\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:31.185255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.185044    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/532ac912-3fb8-47b8-b23f-3451c284295c-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:31.764323 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.764286    6126 generic.go:356] "Generic (PLEG): container finished" podID="532ac912-3fb8-47b8-b23f-3451c284295c" containerID="fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb" exitCode=0
Oct 30 23:46:31.764856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.764336    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"
Oct 30 23:46:31.764856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.764372    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" event={"ID":"532ac912-3fb8-47b8-b23f-3451c284295c","Type":"ContainerDied","Data":"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"}
Oct 30 23:46:31.764856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.764436    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw" event={"ID":"532ac912-3fb8-47b8-b23f-3451c284295c","Type":"ContainerDied","Data":"c780daaf1a4679995d6448009692f5f09a59fb2725eb8dc3498cd3f34ff87644"}
Oct 30 23:46:31.764856 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.764468    6126 scope.go:122] "RemoveContainer" containerID="fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"
Oct 30 23:46:31.776361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.776343    6126 scope.go:122] "RemoveContainer" containerID="fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"
Oct 30 23:46:31.776675 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:46:31.776656    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb\": container with ID starting with fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb not found: ID does not exist" containerID="fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"
Oct 30 23:46:31.776729 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.776682    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb"} err="failed to get container status \"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb\": rpc error: code = NotFound desc = could not find container \"fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb\": container with ID starting with fc43ea644266f5f93060c5754540756185f082a56c72735ba3713d3d44c1dbeb not found: ID does not exist"
Oct 30 23:46:31.931993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.931956    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:46:31.982537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:31.982502    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-057303-6f7b6d8f7-qnzvw"]
Oct 30 23:46:32.407288 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:32.407257    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="532ac912-3fb8-47b8-b23f-3451c284295c" path="/var/lib/kubelet/pods/532ac912-3fb8-47b8-b23f-3451c284295c/volumes"
Oct 30 23:46:34.152069 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:46:34.152029    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:46:35.313435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.313396    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:46:35.314159 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314142    6126 cpu_manager.go:414] "containerMap: removing container" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy"
Oct 30 23:46:35.314211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314163    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy"
Oct 30 23:46:35.314211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314183    6126 cpu_manager.go:414] "containerMap: removing container" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.314211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314189    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.314211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314194    6126 cpu_manager.go:414] "containerMap: removing container" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy"
Oct 30 23:46:35.314211 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314199    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314218    6126 cpu_manager.go:414] "containerMap: removing container" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314222    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314236    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314243    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314261    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314266    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314274    6126 cpu_manager.go:414] "containerMap: removing container" podUID="532ac912-3fb8-47b8-b23f-3451c284295c" containerName="maas-api"
Oct 30 23:46:35.314365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314278    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="532ac912-3fb8-47b8-b23f-3451c284295c" containerName="maas-api"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314375    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3dca1ae-6cac-41ae-97a7-36b83aad481e" containerName="istio-proxy"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314387    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b393ab3-1693-4e24-83cc-109dbbb88cbd" containerName="istio-proxy"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314396    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="532ac912-3fb8-47b8-b23f-3451c284295c" containerName="maas-api"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314411    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="94286c50-3d3b-49e9-a553-5bd24afffa9f" containerName="istio-proxy"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314421    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314427    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="eedb6247-27aa-4706-b991-a57596d96efb" containerName="istio-proxy"
Oct 30 23:46:35.314591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.314434    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="40e6a195-f46b-4a23-9751-82da2f310bd1" containerName="istio-proxy"
Oct 30 23:46:35.319357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.319337    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.364200 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.364170    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:46:35.368433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.368419    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.414262 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.414225    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:46:35.429105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.429073    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:46:35.438112 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438076    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438131    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438255    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgx8q\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438346 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438305    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438392    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438429    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438499 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438453    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438562    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438605    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438741 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438718    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438769    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.438846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438809    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.438846 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438836    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.439026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438929    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6djg\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.439026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.438953    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.439026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.439007    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.439189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.439044    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.439189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.439077    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.540390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540355    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.540390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540392    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540420    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgx8q\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540448    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540497    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540529    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540552    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540601    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.540708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540696    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540749    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540780    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540825    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540853    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540888    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540978    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6djg\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540979    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541009    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541039    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541083    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541131    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541158    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541169    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541411    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541466    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.540976    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.541649 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541490    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.542035 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541716    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.542035 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.541752    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.543720 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.543697    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.544036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.544019    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.544113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.544043    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.544291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.544274    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.598938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.598868    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.599100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.599028    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6djg\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\") pod \"maas-default-gateway-openshift-default-5df48fcc99-z8t72\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.599100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.599068    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.599213 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.599121    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgx8q\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\") pod \"maas-default-gateway-openshift-default-5df48fcc99-l6g77\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:35.633586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.633559    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:35.684371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:35.684339    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:36.069163 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.069133    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:46:36.110339 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:46:36.110313    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437c1522_65b9_4865_af16_8e681fd44b11.slice/crio-c8964acbded0e1e888b3bf1f5c7f8eed065123dca2b6bd5ca9c968880f7f8d1c WatchSource:0}: Error finding container c8964acbded0e1e888b3bf1f5c7f8eed065123dca2b6bd5ca9c968880f7f8d1c: Status 404 returned error can't find the container with id c8964acbded0e1e888b3bf1f5c7f8eed065123dca2b6bd5ca9c968880f7f8d1c
Oct 30 23:46:36.112872 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.112838    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.112955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.112911    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.112955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.112945    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.122528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.122505    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:46:36.125276 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:46:36.125244    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a92a279_1b3c_4753_afa0_e56eb2bc6e64.slice/crio-e999730179305a2f856e60fa00f28219dd1f8083abd78a9b2eea38965e0305fb WatchSource:0}: Error finding container e999730179305a2f856e60fa00f28219dd1f8083abd78a9b2eea38965e0305fb: Status 404 returned error can't find the container with id e999730179305a2f856e60fa00f28219dd1f8083abd78a9b2eea38965e0305fb
Oct 30 23:46:36.127910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.127875    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.127995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.127957    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.128042 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.128000    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:36.242640 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.242233    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:46:36.249677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.247351    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.305369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.305246    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:46:36.306087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.306064    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-71a68a-openshift-default-dockercfg-hdm8z\""
Oct 30 23:46:36.351188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351109    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351180    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351202    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351228    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351248    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351267    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351298    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxcx\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351331    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.351599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.351352    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453403    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453459    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453681 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453646    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453736    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453767    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453808    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453840    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453869    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.453984 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.453923    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxcx\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.454016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.454002    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.454052 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.454030    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.454654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.454374    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.454654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.454374    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.454654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.454590    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.456801 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.456780    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.456881 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.456812    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.520125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.520098    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.520370 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.520346    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxcx\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\") pod \"e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") " pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.565374 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.565348    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:36.840415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.840155    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" event={"ID":"5a92a279-1b3c-4753-afa0-e56eb2bc6e64","Type":"ContainerStarted","Data":"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"}
Oct 30 23:46:36.840415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.840224    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" event={"ID":"5a92a279-1b3c-4753-afa0-e56eb2bc6e64","Type":"ContainerStarted","Data":"e999730179305a2f856e60fa00f28219dd1f8083abd78a9b2eea38965e0305fb"}
Oct 30 23:46:36.849978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.849945    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" event={"ID":"437c1522-65b9-4865-af16-8e681fd44b11","Type":"ContainerStarted","Data":"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"}
Oct 30 23:46:36.850149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.850004    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" event={"ID":"437c1522-65b9-4865-af16-8e681fd44b11","Type":"ContainerStarted","Data":"c8964acbded0e1e888b3bf1f5c7f8eed065123dca2b6bd5ca9c968880f7f8d1c"}
Oct 30 23:46:36.988639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:36.978941    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:46:37.041008 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.040953    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podStartSLOduration=2.040933408 podStartE2EDuration="2.040933408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:36.978606999 +0000 UTC m=+2368.738699573" watchObservedRunningTime="2026-10-30 23:46:37.040933408 +0000 UTC m=+2368.801025981"
Oct 30 23:46:37.041221 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.041180    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:37.041293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.041271    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:37.041350 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.041315    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:46:37.167145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.164151    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podStartSLOduration=2.164129137 podStartE2EDuration="2.164129137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:37.108293104 +0000 UTC m=+2368.868385689" watchObservedRunningTime="2026-10-30 23:46:37.164129137 +0000 UTC m=+2368.924221709"
Oct 30 23:46:37.642698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.635001    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:37.642698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.635155    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:37.642698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.635216    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:37.700662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.687651    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:37.700662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.687787    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:37.700662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.687830    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:37.863508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.863468    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" event={"ID":"469a8266-5df9-4623-8d6e-a437879fd800","Type":"ContainerStarted","Data":"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"}
Oct 30 23:46:37.863702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.863570    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" event={"ID":"469a8266-5df9-4623-8d6e-a437879fd800","Type":"ContainerStarted","Data":"5d3f6f52d375660a0cb6fee335b56b64484f92acb7058c24b06a37956d95fbbe"}
Oct 30 23:46:37.999645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:37.998885    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podStartSLOduration=1.998863584 podStartE2EDuration="1.998863584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:37.997098406 +0000 UTC m=+2369.757190979" watchObservedRunningTime="2026-10-30 23:46:37.998863584 +0000 UTC m=+2369.758956156"
Oct 30 23:46:38.569691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.568735    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:38.569691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.568863    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:38.569691 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.568914    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:38.640644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.637054    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:38.640644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.637121    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:38.719643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.719105    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:38.719643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:38.719169    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:39.571730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.569034    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:39.571730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.569100    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:39.639673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.635960    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:39.639673 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.636017    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:39.690639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.687910    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:39.690639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:39.687982    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:40.088711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.014869    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:46:40.088711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.015135    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" containerID="cri-o://232b38c27e33fa14892d012cb94d4b3e46c03c37ce47aec9e4caea723255c789" gracePeriod=30
Oct 30 23:46:40.573641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.573014    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:40.573641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.573080    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:40.636639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.636055    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:40.636639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.636131    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:40.690643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.689082    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:40.690643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:40.689154    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:41.570639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.567983    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:41.570639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.568044    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:41.644642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.637042    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:41.644642 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.637118    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:41.699641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.685049    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:41.699641 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:41.685124    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:42.567702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.567660    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:42.568034 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.567993    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:42.634701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.634660    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:42.635140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.634751    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:42.686830 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.686793    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:42.687111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:42.687081    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:43.566365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.566321    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused" start-of-body=
Oct 30 23:46:43.566608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.566402    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.144:15021/healthz/ready\": dial tcp 10.134.0.144:15021: connect: connection refused"
Oct 30 23:46:43.636196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.636089    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:43.636196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.636183    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:43.685827 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.685791    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:46:43.686188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:43.686111    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": dial tcp 10.134.0.143:15021: connect: connection refused"
Oct 30 23:46:44.663463 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.663414    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-z8t72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:46:44.664246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.664199    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 23:46:44.869468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.867380    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:44.869468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.868607    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:44.870652 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.870568    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:46:44.885415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.884974    6126 patch_prober.go:29] interesting pod/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:46:44.885415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:44.885067    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:46:45.578540 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.578511    6126 generic.go:356] "Generic (PLEG): container finished" podID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerID="232b38c27e33fa14892d012cb94d4b3e46c03c37ce47aec9e4caea723255c789" exitCode=0
Oct 30 23:46:45.588555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.586968    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerDied","Data":"232b38c27e33fa14892d012cb94d4b3e46c03c37ce47aec9e4caea723255c789"}
Oct 30 23:46:45.588555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.588358    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z" event={"ID":"8ed281f6-ea15-42b1-92cf-989b908b8135","Type":"ContainerDied","Data":"a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2"}
Oct 30 23:46:45.588555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.588392    6126 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a740f6873f9be1d1577ee009317e9fc94d319f066c69c036ce41435597f007f2"
Oct 30 23:46:45.588555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.588412    6126 scope.go:122] "RemoveContainer" containerID="6f761952cb5c0785aa295cc26019674ab2c31620a7aeb55fd7214427ce9e3b85"
Oct 30 23:46:45.590579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.590326    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:46:45.730807 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.730775    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-l6g77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.143:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:46:45.731516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.731466    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.143:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.753899    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.753953    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.753988    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754092    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754198    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754293    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754424    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754478    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.754650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.754509    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\") pod \"8ed281f6-ea15-42b1-92cf-989b908b8135\" (UID: \"8ed281f6-ea15-42b1-92cf-989b908b8135\") "
Oct 30 23:46:45.756249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.755272    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:45.756249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.755532    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:45.756249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.755558    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:45.756249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.755690    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:45.756249 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.755814    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:45.758325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.757572    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed281f6-ea15-42b1-92cf-989b908b8135-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.758325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.757598    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.758325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.757631    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.758325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.757646    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.758325 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.757661    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.758857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.758754    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:45.777407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.777288    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "kube-api-access-wz4d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:45.777407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.777372    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:45.779114 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.779076    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo" pod "8ed281f6-ea15-42b1-92cf-989b908b8135" (UID: "8ed281f6-ea15-42b1-92cf-989b908b8135"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:45.859441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.859408    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz4d9\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-kube-api-access-wz4d9\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.859441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.859439    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.859656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.859456    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.859656 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.859469    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed281f6-ea15-42b1-92cf-989b908b8135-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:46:45.887912 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.887873    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:45.889653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.889354    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:45.891092 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.891070    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:46:45.946527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.946497    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:45.947148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.947054    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:45.947749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:45.947726    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:46:46.599181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:46.599143    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"
Oct 30 23:46:46.834150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:46.834117    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:46:46.837523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:46.837493    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-057303-openshift-default-5798ff8fd9-bf48z"]
Oct 30 23:46:48.409017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:48.408980    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" path="/var/lib/kubelet/pods/8ed281f6-ea15-42b1-92cf-989b908b8135/volumes"
Oct 30 23:46:51.878223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.878190    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:46:51.878905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.878889    6126 cpu_manager.go:414] "containerMap: removing container" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.878955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.878906    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.878955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.878938    6126 cpu_manager.go:414] "containerMap: removing container" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.878955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.878943    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.879059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.879050    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.879100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.879065    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ed281f6-ea15-42b1-92cf-989b908b8135" containerName="istio-proxy"
Oct 30 23:46:51.883959 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.883937    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:51.939004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.938975    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:46:51.946150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.946115    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9pw\" (UniqueName: \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:51.946471 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.946448    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:51.990980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.990946    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-15b137\""
Oct 30 23:46:51.991560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:51.991541    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-15b137-dockercfg-6bbs2\""
Oct 30 23:46:52.037914 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.037877    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:46:52.043578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.043553    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.048603 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.048575    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9pw\" (UniqueName: \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:52.048862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.048711    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:52.049662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.049594    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:52.097093 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.097057    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:46:52.107290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.107262    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9pw\" (UniqueName: \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\") pod \"payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:52.150430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.150348    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbr9\" (UniqueName: \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.150601 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.150472    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.197900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.197869    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:52.252421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.252379    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbr9\" (UniqueName: \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.252643 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.252458    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.253157 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.253134    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.311199 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.310934    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbr9\" (UniqueName: \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\") pod \"payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.360382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.360348    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:52.582644 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.582601    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:46:52.584174 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:46:52.584147    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d624a70_6c08_4349_ace3_a613ad7014be.slice/crio-ada87543c5010fd027f643166a66b8e49fcf1c9ff3c6e2e6032e3d2f1374b875 WatchSource:0}: Error finding container ada87543c5010fd027f643166a66b8e49fcf1c9ff3c6e2e6032e3d2f1374b875: Status 404 returned error can't find the container with id ada87543c5010fd027f643166a66b8e49fcf1c9ff3c6e2e6032e3d2f1374b875
Oct 30 23:46:52.650400 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.650372    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" event={"ID":"0d624a70-6c08-4349-ace3-a613ad7014be","Type":"ContainerStarted","Data":"ada87543c5010fd027f643166a66b8e49fcf1c9ff3c6e2e6032e3d2f1374b875"}
Oct 30 23:46:52.738023 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:52.737997    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:46:52.739576 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:46:52.739548    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5114e2aa_0c64_447a_92a3_63da159d783f.slice/crio-512cc44ca1eb5412bdcbf1df1ab8b2ddba13a20815e1da53ced6c8f879fc8ccd WatchSource:0}: Error finding container 512cc44ca1eb5412bdcbf1df1ab8b2ddba13a20815e1da53ced6c8f879fc8ccd: Status 404 returned error can't find the container with id 512cc44ca1eb5412bdcbf1df1ab8b2ddba13a20815e1da53ced6c8f879fc8ccd
Oct 30 23:46:53.658868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.658830    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" event={"ID":"0d624a70-6c08-4349-ace3-a613ad7014be","Type":"ContainerStarted","Data":"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"}
Oct 30 23:46:53.659331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.658893    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:46:53.660780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.660497    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" event={"ID":"5114e2aa-0c64-447a-92a3-63da159d783f","Type":"ContainerStarted","Data":"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"}
Oct 30 23:46:53.660780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.660544    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" event={"ID":"5114e2aa-0c64-447a-92a3-63da159d783f","Type":"ContainerStarted","Data":"512cc44ca1eb5412bdcbf1df1ab8b2ddba13a20815e1da53ced6c8f879fc8ccd"}
Oct 30 23:46:53.660780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.660608    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:46:53.777380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.777330    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" podStartSLOduration=2.777316389 podStartE2EDuration="2.777316389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:53.774935272 +0000 UTC m=+2385.535027856" watchObservedRunningTime="2026-10-30 23:46:53.777316389 +0000 UTC m=+2385.537408959"
Oct 30 23:46:53.895438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:53.895383    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" podStartSLOduration=2.895367592 podStartE2EDuration="2.895367592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:53.894025605 +0000 UTC m=+2385.654118159" watchObservedRunningTime="2026-10-30 23:46:53.895367592 +0000 UTC m=+2385.655460163"
Oct 30 23:46:59.178662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.178599    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:46:59.185207 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.185174    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.248862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.245128    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:46:59.257125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.257088    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgd85\" (UniqueName: \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.257307 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.257158    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.278662 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.278605    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-276bec\""
Oct 30 23:46:59.278817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.278703    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-276bec-dockercfg-f97bn\""
Oct 30 23:46:59.358707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.358677    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgd85\" (UniqueName: \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.358920 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.358721    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.359447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.359427    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.417539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.417507    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgd85\" (UniqueName: \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\") pod \"payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") " pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.521754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.521718    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:46:59.905236 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:46:59.905198    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:46:59.907151 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:46:59.907120    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfa0346_f3d2_4c7a_9227_f08bd3aa82d4.slice/crio-a7b0f3c38e395a05ced6101e8dfa0aa4f0e85a7f6a518e5b5c9e6e3b0a3f239e WatchSource:0}: Error finding container a7b0f3c38e395a05ced6101e8dfa0aa4f0e85a7f6a518e5b5c9e6e3b0a3f239e: Status 404 returned error can't find the container with id a7b0f3c38e395a05ced6101e8dfa0aa4f0e85a7f6a518e5b5c9e6e3b0a3f239e
Oct 30 23:47:00.710316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:00.710266    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" event={"ID":"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4","Type":"ContainerStarted","Data":"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"}
Oct 30 23:47:00.710771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:00.710334    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" event={"ID":"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4","Type":"ContainerStarted","Data":"a7b0f3c38e395a05ced6101e8dfa0aa4f0e85a7f6a518e5b5c9e6e3b0a3f239e"}
Oct 30 23:47:00.710771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:00.710395    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:47:00.825697 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:00.825597    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" podStartSLOduration=1.825577837 podStartE2EDuration="1.825577837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:00.824332385 +0000 UTC m=+2392.584424953" watchObservedRunningTime="2026-10-30 23:47:00.825577837 +0000 UTC m=+2392.585670409"
Oct 30 23:47:04.152743 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:47:04.152703    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:47:04.670589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:04.670561    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:47:04.670808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:04.670663    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:47:08.867780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:08.867754    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:47:08.878161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:08.878140    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:47:09.269745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:09.269716    6126 scope.go:122] "RemoveContainer" containerID="232b38c27e33fa14892d012cb94d4b3e46c03c37ce47aec9e4caea723255c789"
Oct 30 23:47:11.721573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:11.721545    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:47:34.157155 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:47:34.157091    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:47:34.931273 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:34.931240    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:47:34.936052 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:34.936028    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:34.992087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:34.992054    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:47:35.034271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.034236    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.034439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.034386    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.034518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.034501    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.034586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.034571    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vthts\" (UniqueName: \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.038063 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.038039    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7c36d6-serving-cert\""
Oct 30 23:47:35.135815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.135783    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.136004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.135835    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.136004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.135877    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vthts\" (UniqueName: \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.136004 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:47:35.135941    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-serving-cert: secret "maas-api-e2e-api-b-7c36d6-serving-cert" not found
Oct 30 23:47:35.136195 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:47:35.136009    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls podName:2a8465c6-e963-41fd-adbf-893fde30f6e6 nodeName:}" failed. No retries permitted until 2026-10-30 23:47:35.635993401 +0000 UTC m=+2427.396085951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls") pod "maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" (UID: "2a8465c6-e963-41fd-adbf-893fde30f6e6") : secret "maas-api-e2e-api-b-7c36d6-serving-cert" not found
Oct 30 23:47:35.136195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.136027    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.136756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.136738    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.138799 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.138780    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.195051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.194964    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vthts\" (UniqueName: \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.643244 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.643207    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.645756 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.645733    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") pod \"maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:35.851401 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:35.851366    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:36.232422 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:36.232385    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:47:36.234708 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:47:36.234684    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8465c6_e963_41fd_adbf_893fde30f6e6.slice/crio-6173d5cd6758137f0a7fe2d5936928f300f59a2c2c83ff093714a5c6d9375802 WatchSource:0}: Error finding container 6173d5cd6758137f0a7fe2d5936928f300f59a2c2c83ff093714a5c6d9375802: Status 404 returned error can't find the container with id 6173d5cd6758137f0a7fe2d5936928f300f59a2c2c83ff093714a5c6d9375802
Oct 30 23:47:36.966987 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:36.966952    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" event={"ID":"2a8465c6-e963-41fd-adbf-893fde30f6e6","Type":"ContainerStarted","Data":"6173d5cd6758137f0a7fe2d5936928f300f59a2c2c83ff093714a5c6d9375802"}
Oct 30 23:47:37.814423 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:37.814389    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:47:37.975005 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:37.974970    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" event={"ID":"2a8465c6-e963-41fd-adbf-893fde30f6e6","Type":"ContainerStarted","Data":"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"}
Oct 30 23:47:37.975210 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:37.975092    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:38.094066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:38.093966    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" podStartSLOduration=3.195097788 podStartE2EDuration="4.093951103s" totalImagesPullingTime="898.853315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:38.091413292 +0000 UTC m=+2429.851505863" watchObservedRunningTime="2026-10-30 23:47:38.093951103 +0000 UTC m=+2429.854043674"
Oct 30 23:47:43.989480 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:43.989447    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:47:52.836877 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:52.836788    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main" containerID="cri-o://0310cfd96714ddd5ee6e40f69113ca8f677fdaa663625b85f0d7015a8f78ea2a" gracePeriod=45
Oct 30 23:47:53.105842 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.105808    6126 generic.go:356] "Generic (PLEG): container finished" podID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerID="0310cfd96714ddd5ee6e40f69113ca8f677fdaa663625b85f0d7015a8f78ea2a" exitCode=0
Oct 30 23:47:53.105973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.105881    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" event={"ID":"13abeae6-c1e5-4b15-8ace-a29424ee281c","Type":"ContainerDied","Data":"0310cfd96714ddd5ee6e40f69113ca8f677fdaa663625b85f0d7015a8f78ea2a"}
Oct 30 23:47:53.105973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.105925    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq" event={"ID":"13abeae6-c1e5-4b15-8ace-a29424ee281c","Type":"ContainerDied","Data":"09680d4f2fa4b276a3c73e13f087eb3650d512195f572ec85d25804c59c8d29c"}
Oct 30 23:47:53.105973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.105942    6126 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09680d4f2fa4b276a3c73e13f087eb3650d512195f572ec85d25804c59c8d29c"
Oct 30 23:47:53.125026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.125000    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:47:53.142467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142445    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142478    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\" (UniqueName: \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142759 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142716    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142759 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142740    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:47:53.142886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142827    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142849    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\" (UniqueName: \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\") pod \"13abeae6-c1e5-4b15-8ace-a29424ee281c\" (UID: \"13abeae6-c1e5-4b15-8ace-a29424ee281c\") "
Oct 30 23:47:53.142886 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.142849    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:47:53.143084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.143059    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:47:53.143362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.143280    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:53.143362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.143299    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:53.143362 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.143313    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:53.144949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.144926    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:47:53.145060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.145039    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:47:53.145124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.145078    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t" pod "13abeae6-c1e5-4b15-8ace-a29424ee281c" (UID: "13abeae6-c1e5-4b15-8ace-a29424ee281c"). InnerVolumeSpecName "kube-api-access-5nq2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:47:53.245171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.245134    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nq2t\" (UniqueName: \"kubernetes.io/projected/13abeae6-c1e5-4b15-8ace-a29424ee281c-kube-api-access-5nq2t\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:53.245171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.245175    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13abeae6-c1e5-4b15-8ace-a29424ee281c-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:53.245429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:53.245198    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13abeae6-c1e5-4b15-8ace-a29424ee281c-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:47:54.113963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:54.113929    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"
Oct 30 23:47:54.279764 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:54.279733    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:47:54.330294 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:54.330262    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-3c9613/distinct-2-w2-3c9613-kserve-5f949846bf-5gnxq"]
Oct 30 23:47:54.408793 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:47:54.408714    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" path="/var/lib/kubelet/pods/13abeae6-c1e5-4b15-8ace-a29424ee281c/volumes"
Oct 30 23:48:00.224235 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.224200    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:48:00.225463 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.225443    6126 cpu_manager.go:414] "containerMap: removing container" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main"
Oct 30 23:48:00.225555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.225465    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main"
Oct 30 23:48:00.225768 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.225739    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="13abeae6-c1e5-4b15-8ace-a29424ee281c" containerName="main"
Oct 30 23:48:00.229949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.229930    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.285085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.285023    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:48:00.331169 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.331124    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-276bec-serving-cert\""
Oct 30 23:48:00.340250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.340220    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.340390 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.340281    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d27cq\" (UniqueName: \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.340432 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.340398    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.340523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.340502    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.442096 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.442055    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.442292 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.442132    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.442363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.442299    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.442363 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.442336    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27cq\" (UniqueName: \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.442492 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:48:00.442449    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-serving-cert: secret "maas-api-e2e-inf-a-276bec-serving-cert" not found
Oct 30 23:48:00.442551 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:48:00.442528    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls podName:13754fbe-0637-4b95-9d95-6302fc13b446 nodeName:}" failed. No retries permitted until 2026-10-30 23:48:00.942508818 +0000 UTC m=+2452.702601387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls") pod "maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" (UID: "13754fbe-0637-4b95-9d95-6302fc13b446") : secret "maas-api-e2e-inf-a-276bec-serving-cert" not found
Oct 30 23:48:00.442957 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.442933    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.444767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.444748    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.502421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.502339    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d27cq\" (UniqueName: \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.949925 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.949842    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:00.952598 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:00.952568    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") pod \"maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:01.146209 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:01.146177    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:01.531980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:01.531948    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:48:01.534019 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:48:01.533992    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13754fbe_0637_4b95_9d95_6302fc13b446.slice/crio-dd0a6dbeb5395a5c6bf679802a60e10ab62ddbc204ff065a67b0ae41f86afcc5 WatchSource:0}: Error finding container dd0a6dbeb5395a5c6bf679802a60e10ab62ddbc204ff065a67b0ae41f86afcc5: Status 404 returned error can't find the container with id dd0a6dbeb5395a5c6bf679802a60e10ab62ddbc204ff065a67b0ae41f86afcc5
Oct 30 23:48:02.171298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:02.171260    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" event={"ID":"13754fbe-0637-4b95-9d95-6302fc13b446","Type":"ContainerStarted","Data":"dd0a6dbeb5395a5c6bf679802a60e10ab62ddbc204ff065a67b0ae41f86afcc5"}
Oct 30 23:48:03.181131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:03.181092    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" event={"ID":"13754fbe-0637-4b95-9d95-6302fc13b446","Type":"ContainerStarted","Data":"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"}
Oct 30 23:48:03.181739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:03.181711    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:04.151796 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:48:04.151759    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:48:09.194975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:09.194946    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:48:09.313694 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:09.313639    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" podStartSLOduration=8.471709013 podStartE2EDuration="9.313604802s" totalImagesPullingTime="841.895789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:03.302405262 +0000 UTC m=+2455.062497834" watchObservedRunningTime="2026-10-30 23:48:09.313604802 +0000 UTC m=+2461.073697373"
Oct 30 23:48:09.330983 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:48:09.330947    6126 scope.go:122] "RemoveContainer" containerID="0310cfd96714ddd5ee6e40f69113ca8f677fdaa663625b85f0d7015a8f78ea2a"
Oct 30 23:48:34.152759 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:48:34.152721    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:49:04.152550 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:04.152507    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:49:07.628078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:07.628035    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:49:07.736267 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:07.736235    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:49:12.629377 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:12.629320    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" podUID="f501679e-9b5d-497f-a4bf-90fe5fea294f" containerName="payload-processing" containerID="cri-o://10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d" gracePeriod=25
Oct 30 23:49:12.736894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:12.736856    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" podUID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" containerName="payload-pre-processing" containerID="cri-o://e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df" gracePeriod=25
Oct 30 23:49:12.907710 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:12.907680    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:49:13.019951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.019926    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:49:13.069006 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.068972    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\" (UniqueName: \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\") pod \"f501679e-9b5d-497f-a4bf-90fe5fea294f\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") "
Oct 30 23:49:13.069170 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.069135    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\") pod \"f501679e-9b5d-497f-a4bf-90fe5fea294f\" (UID: \"f501679e-9b5d-497f-a4bf-90fe5fea294f\") "
Oct 30 23:49:13.069606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.069567    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume" pod "f501679e-9b5d-497f-a4bf-90fe5fea294f" (UID: "f501679e-9b5d-497f-a4bf-90fe5fea294f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:13.071312 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.071286    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv" pod "f501679e-9b5d-497f-a4bf-90fe5fea294f" (UID: "f501679e-9b5d-497f-a4bf-90fe5fea294f"). InnerVolumeSpecName "kube-api-access-p85jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:13.170906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.170814    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\" (UniqueName: \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\") pod \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") "
Oct 30 23:49:13.171087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.170960    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\") pod \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\" (UID: \"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff\") "
Oct 30 23:49:13.171404 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.171370    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume" pod "0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" (UID: "0ca7efd1-0cbc-4ea1-8637-6d04043df1ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:13.171559 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.171541    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p85jv\" (UniqueName: \"kubernetes.io/projected/f501679e-9b5d-497f-a4bf-90fe5fea294f-kube-api-access-p85jv\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:13.171671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.171561    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f501679e-9b5d-497f-a4bf-90fe5fea294f-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:13.171671 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.171571    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:13.173287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.173258    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t" pod "0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" (UID: "0ca7efd1-0cbc-4ea1-8637-6d04043df1ff"). InnerVolumeSpecName "kube-api-access-c258t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:13.273269 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.273232    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c258t\" (UniqueName: \"kubernetes.io/projected/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff-kube-api-access-c258t\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:13.684803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.684772    6126 generic.go:356] "Generic (PLEG): container finished" podID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" containerID="e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df" exitCode=0
Oct 30 23:49:13.685320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.684834    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"
Oct 30 23:49:13.685320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.684854    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" event={"ID":"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff","Type":"ContainerDied","Data":"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"}
Oct 30 23:49:13.685320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.684922    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp" event={"ID":"0ca7efd1-0cbc-4ea1-8637-6d04043df1ff","Type":"ContainerDied","Data":"f65d555de4c6db33a84639d3234083b2a31e2e598b70d2c746a5faca9110830e"}
Oct 30 23:49:13.685320 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.684954    6126 scope.go:122] "RemoveContainer" containerID="e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"
Oct 30 23:49:13.686530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.686478    6126 generic.go:356] "Generic (PLEG): container finished" podID="f501679e-9b5d-497f-a4bf-90fe5fea294f" containerID="10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d" exitCode=0
Oct 30 23:49:13.686530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.686508    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" event={"ID":"f501679e-9b5d-497f-a4bf-90fe5fea294f","Type":"ContainerDied","Data":"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"}
Oct 30 23:49:13.686530 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.686519    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"
Oct 30 23:49:13.686805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.686548    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn" event={"ID":"f501679e-9b5d-497f-a4bf-90fe5fea294f","Type":"ContainerDied","Data":"1e1ec9b432f1ec9b368160e2e5e86a982673f2a32991923f048361a0aa84f4b5"}
Oct 30 23:49:13.697009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.696984    6126 scope.go:122] "RemoveContainer" containerID="e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"
Oct 30 23:49:13.697332 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:13.697306    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df\": container with ID starting with e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df not found: ID does not exist" containerID="e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"
Oct 30 23:49:13.697439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.697345    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df"} err="failed to get container status \"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df\": rpc error: code = NotFound desc = could not find container \"e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df\": container with ID starting with e4fce94375675f0d1ebb1adf1110c8f549c9db7280a81ba887c189aa865cd1df not found: ID does not exist"
Oct 30 23:49:13.697439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.697367    6126 scope.go:122] "RemoveContainer" containerID="10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"
Oct 30 23:49:13.709060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.709040    6126 scope.go:122] "RemoveContainer" containerID="10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"
Oct 30 23:49:13.709361 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:13.709344    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d\": container with ID starting with 10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d not found: ID does not exist" containerID="10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"
Oct 30 23:49:13.709424 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.709373    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d"} err="failed to get container status \"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d\": rpc error: code = NotFound desc = could not find container \"10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d\": container with ID starting with 10528fd082bf6a227088cae597bd33e9a24fc35503167e4ac89cf10201ae180d not found: ID does not exist"
Oct 30 23:49:13.851229 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.851147    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:49:13.854167 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.854143    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-505c1f-6f79b874cf-lmhxn"]
Oct 30 23:49:13.964975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.964896    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:49:13.967754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:13.967734    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-505c1f-5b7f698775-d8gvp"]
Oct 30 23:49:14.408316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:14.408278    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" path="/var/lib/kubelet/pods/0ca7efd1-0cbc-4ea1-8637-6d04043df1ff/volumes"
Oct 30 23:49:14.408726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:14.408707    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f501679e-9b5d-497f-a4bf-90fe5fea294f" path="/var/lib/kubelet/pods/f501679e-9b5d-497f-a4bf-90fe5fea294f/volumes"
Oct 30 23:49:25.663360 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:25.663274    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:49:25.663847 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:25.663555    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" podUID="21c93061-e5dd-4f46-b4ac-ee32879faada" containerName="maas-api" containerID="cri-o://fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5" gracePeriod=30
Oct 30 23:49:25.966995 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:25.966963    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:49:26.043425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.043393    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") pod \"21c93061-e5dd-4f46-b4ac-ee32879faada\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") "
Oct 30 23:49:26.043425 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.043427    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\") pod \"21c93061-e5dd-4f46-b4ac-ee32879faada\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") "
Oct 30 23:49:26.043695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.043464    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\") pod \"21c93061-e5dd-4f46-b4ac-ee32879faada\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") "
Oct 30 23:49:26.043695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.043597    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\" (UniqueName: \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\") pod \"21c93061-e5dd-4f46-b4ac-ee32879faada\" (UID: \"21c93061-e5dd-4f46-b4ac-ee32879faada\") "
Oct 30 23:49:26.043875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.043846    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca" pod "21c93061-e5dd-4f46-b4ac-ee32879faada" (UID: "21c93061-e5dd-4f46-b4ac-ee32879faada"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:26.044150 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.044128    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c93061-e5dd-4f46-b4ac-ee32879faada-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:26.045834 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.045801    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls" pod "21c93061-e5dd-4f46-b4ac-ee32879faada" (UID: "21c93061-e5dd-4f46-b4ac-ee32879faada"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:49:26.045930 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.045865    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6" pod "21c93061-e5dd-4f46-b4ac-ee32879faada" (UID: "21c93061-e5dd-4f46-b4ac-ee32879faada"). InnerVolumeSpecName "kube-api-access-skxc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:26.045975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.045949    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs" pod "21c93061-e5dd-4f46-b4ac-ee32879faada" (UID: "21c93061-e5dd-4f46-b4ac-ee32879faada"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:49:26.145415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.145372    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skxc6\" (UniqueName: \"kubernetes.io/projected/21c93061-e5dd-4f46-b4ac-ee32879faada-kube-api-access-skxc6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:26.145415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.145404    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:26.145415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.145414    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21c93061-e5dd-4f46-b4ac-ee32879faada-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:26.783212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.783173    6126 generic.go:356] "Generic (PLEG): container finished" podID="21c93061-e5dd-4f46-b4ac-ee32879faada" containerID="fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5" exitCode=0
Oct 30 23:49:26.783745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.783237    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"
Oct 30 23:49:26.783745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.783267    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" event={"ID":"21c93061-e5dd-4f46-b4ac-ee32879faada","Type":"ContainerDied","Data":"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"}
Oct 30 23:49:26.783745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.783334    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79" event={"ID":"21c93061-e5dd-4f46-b4ac-ee32879faada","Type":"ContainerDied","Data":"f782c26000ca45add0c6e81b509ea0f1ee9240c6bad51ba8ae63794114d50f62"}
Oct 30 23:49:26.783745 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.783362    6126 scope.go:122] "RemoveContainer" containerID="fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"
Oct 30 23:49:26.798193 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.798166    6126 scope.go:122] "RemoveContainer" containerID="fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"
Oct 30 23:49:26.798560 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:26.798537    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5\": container with ID starting with fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5 not found: ID does not exist" containerID="fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"
Oct 30 23:49:26.798677 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.798570    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5"} err="failed to get container status \"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5\": rpc error: code = NotFound desc = could not find container \"fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5\": container with ID starting with fdac3683846f2b0e7a6b6f8e21090efa89d3601139eb1687dfddc1f4e2a898b5 not found: ID does not exist"
Oct 30 23:49:26.954464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.954430    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:49:26.957462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:26.957439    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3c9613-686cccf7cd-tpm79"]
Oct 30 23:49:28.411103 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:28.411050    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21c93061-e5dd-4f46-b4ac-ee32879faada" path="/var/lib/kubelet/pods/21c93061-e5dd-4f46-b4ac-ee32879faada/volumes"
Oct 30 23:49:30.813719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.813690    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:49:30.814371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814357    6126 cpu_manager.go:414] "containerMap: removing container" podUID="21c93061-e5dd-4f46-b4ac-ee32879faada" containerName="maas-api"
Oct 30 23:49:30.814437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814372    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21c93061-e5dd-4f46-b4ac-ee32879faada" containerName="maas-api"
Oct 30 23:49:30.814437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814419    6126 cpu_manager.go:414] "containerMap: removing container" podUID="f501679e-9b5d-497f-a4bf-90fe5fea294f" containerName="payload-processing"
Oct 30 23:49:30.814437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814424    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f501679e-9b5d-497f-a4bf-90fe5fea294f" containerName="payload-processing"
Oct 30 23:49:30.814437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814433    6126 cpu_manager.go:414] "containerMap: removing container" podUID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" containerName="payload-pre-processing"
Oct 30 23:49:30.814437 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814438    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" containerName="payload-pre-processing"
Oct 30 23:49:30.814726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814529    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="21c93061-e5dd-4f46-b4ac-ee32879faada" containerName="maas-api"
Oct 30 23:49:30.814726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814545    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="f501679e-9b5d-497f-a4bf-90fe5fea294f" containerName="payload-processing"
Oct 30 23:49:30.814726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.814552    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ca7efd1-0cbc-4ea1-8637-6d04043df1ff" containerName="payload-pre-processing"
Oct 30 23:49:30.818142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.818121    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:30.875171 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.875139    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:49:30.960885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.960855    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-333b59\""
Oct 30 23:49:30.961237 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.961215    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-333b59-dockercfg-9zm6b\""
Oct 30 23:49:30.963790 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.963462    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52v7w\" (UniqueName: \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:30.963790 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:30.963498    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.006414 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.006382    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:49:31.010631 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.010598    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.028651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.025456    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:49:31.065032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.064952    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctpz6\" (UniqueName: \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.065032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.065021    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.065276 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.065250    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52v7w\" (UniqueName: \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.065316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.065294    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.066026 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.066010    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.123203 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.123170    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52v7w\" (UniqueName: \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\") pod \"payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.133271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.133239    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.166298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.166263    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctpz6\" (UniqueName: \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.166428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.166354    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.167234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.167209    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.245672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.245600    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctpz6\" (UniqueName: \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\") pod \"payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") " pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.331122 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.331024    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.527782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.527751    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:49:31.527950 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:49:31.527928    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f25999_f0d2_4cd4_8120_b5d75a2dcaaf.slice/crio-0357feef378c4ff21a30fd2ac881e9d40170b94c6f702df02a09fb63c70b2a3c WatchSource:0}: Error finding container 0357feef378c4ff21a30fd2ac881e9d40170b94c6f702df02a09fb63c70b2a3c: Status 404 returned error can't find the container with id 0357feef378c4ff21a30fd2ac881e9d40170b94c6f702df02a09fb63c70b2a3c
Oct 30 23:49:31.715367 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.715333    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:49:31.717405 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:49:31.717376    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dde2edb_297e_4c3c_b4b2_64e931435460.slice/crio-3c7a47a2450318a095b245a7eee04e1c600d6445f32b175a8fbf7c14b623fbf5 WatchSource:0}: Error finding container 3c7a47a2450318a095b245a7eee04e1c600d6445f32b175a8fbf7c14b623fbf5: Status 404 returned error can't find the container with id 3c7a47a2450318a095b245a7eee04e1c600d6445f32b175a8fbf7c14b623fbf5
Oct 30 23:49:31.819458 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.819420    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" event={"ID":"9dde2edb-297e-4c3c-b4b2-64e931435460","Type":"ContainerStarted","Data":"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"}
Oct 30 23:49:31.819897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.819478    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" event={"ID":"9dde2edb-297e-4c3c-b4b2-64e931435460","Type":"ContainerStarted","Data":"3c7a47a2450318a095b245a7eee04e1c600d6445f32b175a8fbf7c14b623fbf5"}
Oct 30 23:49:31.819897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.819506    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:49:31.821285 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.821256    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" event={"ID":"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf","Type":"ContainerStarted","Data":"19398d019a3526704e4be1e9a99232df4c62ab5f7500589c9e3610870d818548"}
Oct 30 23:49:31.821407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.821298    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" event={"ID":"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf","Type":"ContainerStarted","Data":"0357feef378c4ff21a30fd2ac881e9d40170b94c6f702df02a09fb63c70b2a3c"}
Oct 30 23:49:31.821407 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.821325    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:31.938550 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:31.938443    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" podStartSLOduration=1.9384303950000001 podStartE2EDuration="1.938430395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:31.935398563 +0000 UTC m=+2543.695491145" watchObservedRunningTime="2026-10-30 23:49:31.938430395 +0000 UTC m=+2543.698522965"
Oct 30 23:49:32.057068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:32.057005    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" podStartSLOduration=2.056987313 podStartE2EDuration="2.056987313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:32.052256069 +0000 UTC m=+2543.812348639" watchObservedRunningTime="2026-10-30 23:49:32.056987313 +0000 UTC m=+2543.817079884"
Oct 30 23:49:34.152628 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:34.152575    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:49:35.367579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:35.367543    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:49:35.368094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:35.367830    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" containerID="cri-o://bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468" gracePeriod=30
Oct 30 23:49:35.451021 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:35.450925    6126 patch_prober.go:29] interesting pod/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:49:35.451238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:35.451048    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:49:40.679629 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.679577    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:49:40.799700 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799664    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.799905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799739    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.799905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799811    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.799905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799849    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.799905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799886    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.800142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799919    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.800142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.799957    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.800142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800016    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.800142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800042    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:49:40.800142 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800051    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\") pod \"bde3834a-34f1-4467-8f73-7408d71012ef\" (UID: \"bde3834a-34f1-4467-8f73-7408d71012ef\") "
Oct 30 23:49:40.800574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800548    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:40.800703 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800652    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:49:40.800703 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800688    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.800836    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.801035    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde3834a-34f1-4467-8f73-7408d71012ef-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.801059    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.801077    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.801091    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.801185 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.801105    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.802815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.802785    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:49:40.809848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.803671    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:49:40.809848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.803800    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:40.809848 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.803938    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v" pod "bde3834a-34f1-4467-8f73-7408d71012ef" (UID: "bde3834a-34f1-4467-8f73-7408d71012ef"). InnerVolumeSpecName "kube-api-access-cvh9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:40.884051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.884010    6126 generic.go:356] "Generic (PLEG): container finished" podID="bde3834a-34f1-4467-8f73-7408d71012ef" containerID="bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468" exitCode=0
Oct 30 23:49:40.884242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.884075    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"
Oct 30 23:49:40.884242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.884105    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" event={"ID":"bde3834a-34f1-4467-8f73-7408d71012ef","Type":"ContainerDied","Data":"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"}
Oct 30 23:49:40.884242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.884164    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k" event={"ID":"bde3834a-34f1-4467-8f73-7408d71012ef","Type":"ContainerDied","Data":"c6479ed71291a2c4e63906ae423c410e926fab7b1f3dad09b77909ba30ac33e9"}
Oct 30 23:49:40.884242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.884190    6126 scope.go:122] "RemoveContainer" containerID="bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"
Oct 30 23:49:40.902081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.902024    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvh9v\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-kube-api-access-cvh9v\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.902081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.902049    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde3834a-34f1-4467-8f73-7408d71012ef-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.902081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.902061    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde3834a-34f1-4467-8f73-7408d71012ef-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.902081 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.902069    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde3834a-34f1-4467-8f73-7408d71012ef-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:49:40.906973 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.906954    6126 scope.go:122] "RemoveContainer" containerID="bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"
Oct 30 23:49:40.907309 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:49:40.907284    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468\": container with ID starting with bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468 not found: ID does not exist" containerID="bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"
Oct 30 23:49:40.907409 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:40.907315    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468"} err="failed to get container status \"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468\": rpc error: code = NotFound desc = could not find container \"bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468\": container with ID starting with bf222594701923569a8cf4ea2233ebedc81d1ba16a92756aa0faa0f4f9bd3468 not found: ID does not exist"
Oct 30 23:49:41.051435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:41.051352    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:49:41.054689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:41.054659    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3c9613-openshift-default-769cf65595-8n67k"]
Oct 30 23:49:42.408053 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:42.408015    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" path="/var/lib/kubelet/pods/bde3834a-34f1-4467-8f73-7408d71012ef/volumes"
Oct 30 23:49:42.830924 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:42.830897    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:49:42.831126 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:49:42.830959    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:50:04.157074 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:50:04.157035    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:50:27.102650 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.102577    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:50:27.103569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.103545    6126 cpu_manager.go:414] "containerMap: removing container" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy"
Oct 30 23:50:27.103726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.103571    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy"
Oct 30 23:50:27.103836 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.103820    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="bde3834a-34f1-4467-8f73-7408d71012ef" containerName="istio-proxy"
Oct 30 23:50:27.108792 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.108772    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.161895 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.161854    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:50:27.162079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.162025    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a8204d\"/\"kube-root-ca.crt\""
Oct 30 23:50:27.162155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.162095    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a8204d\"/\"openshift-service-ca.crt\""
Oct 30 23:50:27.208113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.208083    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a8204d\"/\"default-dockercfg-jnbv7\""
Oct 30 23:50:27.208113 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.208105    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a8204d\"/\"test-model-a8204d-kserve-self-signed-certs\""
Oct 30 23:50:27.228000 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.227971    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.228160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.228021    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.228160 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.228114    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.228281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.228174    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.228339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.228298    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7fl\" (UniqueName: \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.228465 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.228444    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330022    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330064    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330191    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330268    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330438 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330373    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7fl\" (UniqueName: \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330432    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330520    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330660 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330611    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.330939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.330856    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.332630 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.332600    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.332869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.332849    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.392124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.392051    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7fl\" (UniqueName: \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\") pod \"test-model-a8204d-kserve-568f7f67d9-lwr8h\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") " pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.421184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.421145    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:27.808910 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:27.808886    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:50:27.810027 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:50:27.809999    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod945fffbd_ea25_4497_9070_bd3a74573d68.slice/crio-f363e70556b76961ecf80711f160686ac9643d32de9a47f6dbda757cd40313ab WatchSource:0}: Error finding container f363e70556b76961ecf80711f160686ac9643d32de9a47f6dbda757cd40313ab: Status 404 returned error can't find the container with id f363e70556b76961ecf80711f160686ac9643d32de9a47f6dbda757cd40313ab
Oct 30 23:50:28.220981 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:28.220946    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" event={"ID":"945fffbd-ea25-4497-9070-bd3a74573d68","Type":"ContainerStarted","Data":"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"}
Oct 30 23:50:28.221455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:28.220999    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" event={"ID":"945fffbd-ea25-4497-9070-bd3a74573d68","Type":"ContainerStarted","Data":"f363e70556b76961ecf80711f160686ac9643d32de9a47f6dbda757cd40313ab"}
Oct 30 23:50:28.338298 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:28.338240    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" podStartSLOduration=1.338226426 podStartE2EDuration="1.338226426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:28.336888936 +0000 UTC m=+2600.096981508" watchObservedRunningTime="2026-10-30 23:50:28.338226426 +0000 UTC m=+2600.098318997"
Oct 30 23:50:28.422214 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:28.422179    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:30.832536 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.832496    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:50:30.838106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.838084    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.873277 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.873241    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf84j\" (UniqueName: \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.873435 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.873303    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.873479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.873426    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.873571 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.873548    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.893719 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.893688    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:50:30.940290 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.940259    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-333b59-serving-cert\""
Oct 30 23:50:30.974885 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.974853    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf84j\" (UniqueName: \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.975068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.974915    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.975068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.975022    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.975191 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.975139    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.975370 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:50:30.975340    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-serving-cert: secret "maas-api-e2e-inf-b-333b59-serving-cert" not found
Oct 30 23:50:30.975513 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:50:30.975429    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls podName:612aa55a-a6c7-4482-9303-ddcdda725d9e nodeName:}" failed. No retries permitted until 2026-10-30 23:50:31.475407454 +0000 UTC m=+2603.235500023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls") pod "maas-api-e2e-inf-b-333b59-7495659846-jsspn" (UID: "612aa55a-a6c7-4482-9303-ddcdda725d9e") : secret "maas-api-e2e-inf-b-333b59-serving-cert" not found
Oct 30 23:50:30.975897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.975872    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:30.978572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:30.978539    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:31.035604 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:31.035563    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf84j\" (UniqueName: \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:31.481005 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:31.480956    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:31.483841 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:31.483810    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") pod \"maas-api-e2e-inf-b-333b59-7495659846-jsspn\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:31.754357 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:31.754277    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:32.137087 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:32.137055    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:50:32.137864 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:50:32.137832    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612aa55a_a6c7_4482_9303_ddcdda725d9e.slice/crio-281d3079b39cb75b65c0f61a319aa81758d052e562225cee026def95e9804091 WatchSource:0}: Error finding container 281d3079b39cb75b65c0f61a319aa81758d052e562225cee026def95e9804091: Status 404 returned error can't find the container with id 281d3079b39cb75b65c0f61a319aa81758d052e562225cee026def95e9804091
Oct 30 23:50:32.139508 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:32.139491    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:50:32.249791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:32.249761    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" event={"ID":"612aa55a-a6c7-4482-9303-ddcdda725d9e","Type":"ContainerStarted","Data":"281d3079b39cb75b65c0f61a319aa81758d052e562225cee026def95e9804091"}
Oct 30 23:50:33.257680 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:33.257643    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" event={"ID":"612aa55a-a6c7-4482-9303-ddcdda725d9e","Type":"ContainerStarted","Data":"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"}
Oct 30 23:50:33.258177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:33.257822    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:33.374505 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:33.374452    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" podStartSLOduration=2.587242795 podStartE2EDuration="3.37443901s" totalImagesPullingTime="787.196215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:33.373243997 +0000 UTC m=+2605.133336568" watchObservedRunningTime="2026-10-30 23:50:33.37443901 +0000 UTC m=+2605.134531617"
Oct 30 23:50:34.152939 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:50:34.152905    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:50:37.422123 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:37.422085    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:37.435791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:37.435762    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:38.306379 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:38.306353    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:50:39.270189 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:39.270159    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:50:54.549225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.549193    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:50:54.549672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.549418    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" podUID="aeb3d803-cdbf-417b-a271-1436100d7544" containerName="maas-api" containerID="cri-o://0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3" gracePeriod=30
Oct 30 23:50:54.835036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.835010    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:50:54.904369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.904336    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") pod \"aeb3d803-cdbf-417b-a271-1436100d7544\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") "
Oct 30 23:50:54.904541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.904455    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\") pod \"aeb3d803-cdbf-417b-a271-1436100d7544\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") "
Oct 30 23:50:54.904726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.904708    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\") pod \"aeb3d803-cdbf-417b-a271-1436100d7544\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") "
Oct 30 23:50:54.904785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.904746    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\" (UniqueName: \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\") pod \"aeb3d803-cdbf-417b-a271-1436100d7544\" (UID: \"aeb3d803-cdbf-417b-a271-1436100d7544\") "
Oct 30 23:50:54.904849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.904824    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca" pod "aeb3d803-cdbf-417b-a271-1436100d7544" (UID: "aeb3d803-cdbf-417b-a271-1436100d7544"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:50:54.905400 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.905372    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb3d803-cdbf-417b-a271-1436100d7544-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:50:54.906840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.906816    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls" pod "aeb3d803-cdbf-417b-a271-1436100d7544" (UID: "aeb3d803-cdbf-417b-a271-1436100d7544"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:50:54.906965 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.906858    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs" pod "aeb3d803-cdbf-417b-a271-1436100d7544" (UID: "aeb3d803-cdbf-417b-a271-1436100d7544"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:50:54.907038 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:54.907019    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f" pod "aeb3d803-cdbf-417b-a271-1436100d7544" (UID: "aeb3d803-cdbf-417b-a271-1436100d7544"). InnerVolumeSpecName "kube-api-access-2kg6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:50:55.006810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.006771    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:50:55.006810 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.006811    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeb3d803-cdbf-417b-a271-1436100d7544-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:50:55.007068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.006828    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kg6f\" (UniqueName: \"kubernetes.io/projected/aeb3d803-cdbf-417b-a271-1436100d7544-kube-api-access-2kg6f\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:50:55.410484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.410368    6126 generic.go:356] "Generic (PLEG): container finished" podID="aeb3d803-cdbf-417b-a271-1436100d7544" containerID="0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3" exitCode=0
Oct 30 23:50:55.410484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.410411    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"
Oct 30 23:50:55.410484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.410430    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" event={"ID":"aeb3d803-cdbf-417b-a271-1436100d7544","Type":"ContainerDied","Data":"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"}
Oct 30 23:50:55.410484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.410478    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b" event={"ID":"aeb3d803-cdbf-417b-a271-1436100d7544","Type":"ContainerDied","Data":"1d81c4eacc9d9d5538d9d9612188adde42d6865b668b58e4b5a95af62debb264"}
Oct 30 23:50:55.422728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.410507    6126 scope.go:122] "RemoveContainer" containerID="0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"
Oct 30 23:50:55.422728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.421316    6126 scope.go:122] "RemoveContainer" containerID="0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"
Oct 30 23:50:55.422728 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:50:55.421606    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3\": container with ID starting with 0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3 not found: ID does not exist" containerID="0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"
Oct 30 23:50:55.422728 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.421652    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3"} err="failed to get container status \"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3\": rpc error: code = NotFound desc = could not find container \"0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3\": container with ID starting with 0697559e0719368b77641007ca9288338e956a4b6b75a25f0ae11dabc779d1f3 not found: ID does not exist"
Oct 30 23:50:55.584421 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.584388    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:50:55.634418 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:55.634379    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-505c1f-74687675f5-vkh6b"]
Oct 30 23:50:56.408980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:50:56.408949    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeb3d803-cdbf-417b-a271-1436100d7544" path="/var/lib/kubelet/pods/aeb3d803-cdbf-417b-a271-1436100d7544/volumes"
Oct 30 23:51:03.272569 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:03.272532    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:51:03.273176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:03.272848    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" containerID="cri-o://5c2481f640731a2e3c48c6fae3a2019522d44fe90e8af09b93e5213697422b9d" gracePeriod=30
Oct 30 23:51:03.393394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:03.393353    6126 patch_prober.go:29] interesting pod/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:51:03.393814 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:03.393784    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:51:04.151669 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:51:04.151630    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:51:08.510880 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.510839    6126 generic.go:356] "Generic (PLEG): container finished" podID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerID="5c2481f640731a2e3c48c6fae3a2019522d44fe90e8af09b93e5213697422b9d" exitCode=0
Oct 30 23:51:08.511441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.511056    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerDied","Data":"5c2481f640731a2e3c48c6fae3a2019522d44fe90e8af09b93e5213697422b9d"}
Oct 30 23:51:08.511441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.511113    6126 scope.go:122] "RemoveContainer" containerID="b12d054481c728f21af5710c8d4e099c2e7e2ecbf670a2649620e162545c07e4"
Oct 30 23:51:08.565383 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.565360    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:51:08.682654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682606    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.682843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682700    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.682843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682790    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.682843 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682825    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682897    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682942    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683027 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.682990    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683065    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683102    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:51:08.683177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683126    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\") pod \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\" (UID: \"42e46bfc-fb7b-46aa-a997-aca9a48b26c5\") "
Oct 30 23:51:08.683331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683248    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:51:08.683384 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683326    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:51:08.683567 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683537    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:51:08.683717 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683647    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:51:08.683952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683925    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.683952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683951    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.684303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683966    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.684303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683982    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.684303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.683996    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.685316 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.685288    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "kube-api-access-sktck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:51:08.685790 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.685768    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:51:08.685976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.685949    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:51:08.685976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.685960    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo" pod "42e46bfc-fb7b-46aa-a997-aca9a48b26c5" (UID: "42e46bfc-fb7b-46aa-a997-aca9a48b26c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:51:08.785704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.785670    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.785704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.785700    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.785913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.785714    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sktck\" (UniqueName: \"kubernetes.io/projected/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-kube-api-access-sktck\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:08.785913 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:08.785729    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e46bfc-fb7b-46aa-a997-aca9a48b26c5-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:51:09.519952 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:09.519920    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"
Oct 30 23:51:09.520457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:09.519953    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq" event={"ID":"42e46bfc-fb7b-46aa-a997-aca9a48b26c5","Type":"ContainerDied","Data":"f435d2655e5753c00358c029933d5e11e155faec208373b972f763fceacbe53c"}
Oct 30 23:51:09.520457 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:09.520009    6126 scope.go:122] "RemoveContainer" containerID="5c2481f640731a2e3c48c6fae3a2019522d44fe90e8af09b93e5213697422b9d"
Oct 30 23:51:09.742701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:09.742668    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:51:09.745315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:09.745290    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-505c1f-openshift-default-55f9bf7669-zj9pq"]
Oct 30 23:51:10.407548 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:51:10.407511    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" path="/var/lib/kubelet/pods/42e46bfc-fb7b-46aa-a997-aca9a48b26c5/volumes"
Oct 30 23:51:34.150968 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:51:34.150929    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:52:04.152704 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:52:04.152664    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:52:08.846931 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:08.846895    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:52:08.847448 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:08.847148    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy" containerID="cri-o://2804141609b13c2c29b979409bcb73643a161d20f83f7dbe68eb7df2e4b5afa4" gracePeriod=30
Oct 30 23:52:08.957012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:08.956976    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:52:08.992058 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:08.992027    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:52:13.971999 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:13.971969    6126 generic.go:356] "Generic (PLEG): container finished" podID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerID="2804141609b13c2c29b979409bcb73643a161d20f83f7dbe68eb7df2e4b5afa4" exitCode=0
Oct 30 23:52:13.972392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:13.972039    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerDied","Data":"2804141609b13c2c29b979409bcb73643a161d20f83f7dbe68eb7df2e4b5afa4"}
Oct 30 23:52:13.972392 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:13.972133    6126 scope.go:122] "RemoveContainer" containerID="8ffa7aef0ad309e055e4d015980d8d1cce3e98814219b86215076e7e650cca6d"
Oct 30 23:52:14.124749 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.124686    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:52:14.251986 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.251956    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252057    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252086    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252130    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252224    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252274    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252293    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:52:14.252371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252300    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252412    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252563    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\") pod \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\" (UID: \"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6\") "
Oct 30 23:52:14.252788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252670    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:52:14.252788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.252774    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:52:14.253225 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.253198    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.253331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.253228    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.253331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.253242    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.253331 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.253321    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:52:14.253849 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.253824    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:52:14.255125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.255097    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:52:14.255528 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.255501    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "kube-api-access-mxkwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:52:14.255676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.255578    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:52:14.255732 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.255722    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy" pod "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" (UID: "6aa686b8-53b9-4b48-a3eb-66f2f78d9be6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:52:14.354164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354127    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.354164 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354162    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.354408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354176    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.354408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354192    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.354408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354207    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxkwr\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-kube-api-access-mxkwr\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.354408 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.354223    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:52:14.980932 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.980904    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"
Oct 30 23:52:14.981497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.980896    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb" event={"ID":"6aa686b8-53b9-4b48-a3eb-66f2f78d9be6","Type":"ContainerDied","Data":"b6c3bc69e4e6a5bb08d881c258243f4f33a70f31c8dda3599db11c3ab221e96b"}
Oct 30 23:52:14.981497 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:14.981036    6126 scope.go:122] "RemoveContainer" containerID="2804141609b13c2c29b979409bcb73643a161d20f83f7dbe68eb7df2e4b5afa4"
Oct 30 23:52:15.199060 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:15.198978    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:52:15.249263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:15.249185    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2cfb80-openshift-default-db787f45c-pjtbb"]
Oct 30 23:52:16.408474 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:52:16.408440    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" path="/var/lib/kubelet/pods/6aa686b8-53b9-4b48-a3eb-66f2f78d9be6/volumes"
Oct 30 23:52:34.152850 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:52:34.152813    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:53:04.152056 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:53:04.152013    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:53:07.562606 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:07.562564    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:53:07.563554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:07.562850    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy" containerID="cri-o://bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8" gracePeriod=30
Oct 30 23:53:12.848419 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.848353    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:53:12.909579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909535    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.909817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909608    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.909817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909680    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.909817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909700    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.909817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909801    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.910078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909841    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.910078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909914    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.910078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909905    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:12.910078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.909929    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:12.910078 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910060    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.910355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910097    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:12.910355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910159    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\") pod \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\" (UID: \"5a92a279-1b3c-4753-afa0-e56eb2bc6e64\") "
Oct 30 23:53:12.910466 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910448    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:12.910525 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910469    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:53:12.911006 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.910979    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:12.911181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.911011    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:12.911181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.911027    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:12.911181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.911040    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:12.911181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.911054    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:12.912413 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.912372    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:53:12.912589 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.912562    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:53:12.912838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.912809    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:12.913124 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:12.913097    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q" pod "5a92a279-1b3c-4753-afa0-e56eb2bc6e64" (UID: "5a92a279-1b3c-4753-afa0-e56eb2bc6e64"). InnerVolumeSpecName "kube-api-access-tgx8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:53:13.013125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.013084    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:13.013125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.013126    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:13.013348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.013142    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgx8q\" (UniqueName: \"kubernetes.io/projected/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-kube-api-access-tgx8q\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:13.013348 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.013158    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a92a279-1b3c-4753-afa0-e56eb2bc6e64-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:13.399553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.399520    6126 generic.go:356] "Generic (PLEG): container finished" podID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerID="bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8" exitCode=0
Oct 30 23:53:13.399813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.399557    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"
Oct 30 23:53:13.399813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.399585    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" event={"ID":"5a92a279-1b3c-4753-afa0-e56eb2bc6e64","Type":"ContainerDied","Data":"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"}
Oct 30 23:53:13.399813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.399665    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77" event={"ID":"5a92a279-1b3c-4753-afa0-e56eb2bc6e64","Type":"ContainerDied","Data":"e999730179305a2f856e60fa00f28219dd1f8083abd78a9b2eea38965e0305fb"}
Oct 30 23:53:13.399813 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.399695    6126 scope.go:122] "RemoveContainer" containerID="bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"
Oct 30 23:53:13.412268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.412251    6126 scope.go:122] "RemoveContainer" containerID="bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"
Oct 30 23:53:13.412659 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:53:13.412597    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8\": container with ID starting with bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8 not found: ID does not exist" containerID="bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"
Oct 30 23:53:13.412808 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.412656    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8"} err="failed to get container status \"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8\": rpc error: code = NotFound desc = could not find container \"bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8\": container with ID starting with bb82de762e8045cc4dc74844063decff87f4c4bc782dbc10c5cc09f37c5768b8 not found: ID does not exist"
Oct 30 23:53:13.568676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.568632    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:53:13.573209 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:13.573181    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-l6g77"]
Oct 30 23:53:14.407947 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:14.407914    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" path="/var/lib/kubelet/pods/5a92a279-1b3c-4753-afa0-e56eb2bc6e64/volumes"
Oct 30 23:53:16.074515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.074481    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:53:16.075016 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.074722    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" podUID="2a8465c6-e963-41fd-adbf-893fde30f6e6" containerName="maas-api" containerID="cri-o://022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce" gracePeriod=30
Oct 30 23:53:16.371767 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.371744    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:53:16.421376 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.421348    6126 generic.go:356] "Generic (PLEG): container finished" podID="2a8465c6-e963-41fd-adbf-893fde30f6e6" containerID="022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce" exitCode=0
Oct 30 23:53:16.421529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.421390    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"
Oct 30 23:53:16.421529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.421430    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" event={"ID":"2a8465c6-e963-41fd-adbf-893fde30f6e6","Type":"ContainerDied","Data":"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"}
Oct 30 23:53:16.421529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.421490    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl" event={"ID":"2a8465c6-e963-41fd-adbf-893fde30f6e6","Type":"ContainerDied","Data":"6173d5cd6758137f0a7fe2d5936928f300f59a2c2c83ff093714a5c6d9375802"}
Oct 30 23:53:16.421529 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.421514    6126 scope.go:122] "RemoveContainer" containerID="022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"
Oct 30 23:53:16.434318 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.434292    6126 scope.go:122] "RemoveContainer" containerID="022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"
Oct 30 23:53:16.434701 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:53:16.434606    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce\": container with ID starting with 022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce not found: ID does not exist" containerID="022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"
Oct 30 23:53:16.434701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.434663    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce"} err="failed to get container status \"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce\": rpc error: code = NotFound desc = could not find container \"022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce\": container with ID starting with 022869a5c4b043183f9ea7ec5c493b97ca18c375771936a9a9d12143310d46ce not found: ID does not exist"
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.470232    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") pod \"2a8465c6-e963-41fd-adbf-893fde30f6e6\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") "
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.470447    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\") pod \"2a8465c6-e963-41fd-adbf-893fde30f6e6\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") "
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.470497    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\") pod \"2a8465c6-e963-41fd-adbf-893fde30f6e6\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") "
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.470681    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\" (UniqueName: \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\") pod \"2a8465c6-e963-41fd-adbf-893fde30f6e6\" (UID: \"2a8465c6-e963-41fd-adbf-893fde30f6e6\") "
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.470880    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca" pod "2a8465c6-e963-41fd-adbf-893fde30f6e6" (UID: "2a8465c6-e963-41fd-adbf-893fde30f6e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:53:16.471701 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.471407    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a8465c6-e963-41fd-adbf-893fde30f6e6-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:16.473431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.473268    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls" pod "2a8465c6-e963-41fd-adbf-893fde30f6e6" (UID: "2a8465c6-e963-41fd-adbf-893fde30f6e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:53:16.473431 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.473310    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs" pod "2a8465c6-e963-41fd-adbf-893fde30f6e6" (UID: "2a8465c6-e963-41fd-adbf-893fde30f6e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:53:16.473667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.473501    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts" pod "2a8465c6-e963-41fd-adbf-893fde30f6e6" (UID: "2a8465c6-e963-41fd-adbf-893fde30f6e6"). InnerVolumeSpecName "kube-api-access-vthts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:53:16.573256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.573218    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vthts\" (UniqueName: \"kubernetes.io/projected/2a8465c6-e963-41fd-adbf-893fde30f6e6-kube-api-access-vthts\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:16.573256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.573252    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:16.573256 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.573263    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a8465c6-e963-41fd-adbf-893fde30f6e6-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:16.843254 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.843215    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:53:16.847829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:16.847802    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7c36d6-59cb4b9579-djjrl"]
Oct 30 23:53:18.409029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:18.408984    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a8465c6-e963-41fd-adbf-893fde30f6e6" path="/var/lib/kubelet/pods/2a8465c6-e963-41fd-adbf-893fde30f6e6/volumes"
Oct 30 23:53:30.798782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:30.798744    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:53:34.150351 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:53:34.150311    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:53:45.825499 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:45.825404    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main" containerID="cri-o://58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530" gracePeriod=45
Oct 30 23:53:46.113260 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.113228    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:53:46.272645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272578    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.272815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272703    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.272815 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272800    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.272948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272854    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\" (UniqueName: \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.272948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272861    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:46.272948 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272917    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\" (UniqueName: \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.273119 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.272972    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\") pod \"009c5ba0-a19c-41b1-bcc9-94df2626188a\" (UID: \"009c5ba0-a19c-41b1-bcc9-94df2626188a\") "
Oct 30 23:53:46.273736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.273196    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:46.273736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.273434    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:46.273736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.273679    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.273736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.273697    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.273736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.273712    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.276126 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.276092    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:53:46.276339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.276315    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "kube-api-access-ng8jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:53:46.276972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.276952    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm" pod "009c5ba0-a19c-41b1-bcc9-94df2626188a" (UID: "009c5ba0-a19c-41b1-bcc9-94df2626188a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:53:46.374706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.374633    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009c5ba0-a19c-41b1-bcc9-94df2626188a-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.374706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.374660    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng8jd\" (UniqueName: \"kubernetes.io/projected/009c5ba0-a19c-41b1-bcc9-94df2626188a-kube-api-access-ng8jd\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.374706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.374671    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009c5ba0-a19c-41b1-bcc9-94df2626188a-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:53:46.631951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.631860    6126 generic.go:356] "Generic (PLEG): container finished" podID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerID="58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530" exitCode=0
Oct 30 23:53:46.631951 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.631909    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"
Oct 30 23:53:46.632153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.631946    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" event={"ID":"009c5ba0-a19c-41b1-bcc9-94df2626188a","Type":"ContainerDied","Data":"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"}
Oct 30 23:53:46.632153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.631990    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66" event={"ID":"009c5ba0-a19c-41b1-bcc9-94df2626188a","Type":"ContainerDied","Data":"63cbe1235b069842c0d868c4802ac536ea3ecdbebae174e04d9b591a1dd3ab81"}
Oct 30 23:53:46.632153 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.632010    6126 scope.go:122] "RemoveContainer" containerID="58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"
Oct 30 23:53:46.644067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.643967    6126 scope.go:122] "RemoveContainer" containerID="58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"
Oct 30 23:53:46.644452 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:53:46.644425    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530\": container with ID starting with 58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530 not found: ID does not exist" containerID="58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"
Oct 30 23:53:46.644547 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.644460    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530"} err="failed to get container status \"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530\": rpc error: code = NotFound desc = could not find container \"58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530\": container with ID starting with 58786868079ef8fc7f7b0ae3566ba0e7be5fb28c40da15ab5db1ea974cf7c530 not found: ID does not exist"
Oct 30 23:53:46.800551 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.800514    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:53:46.848968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:46.848936    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-2cfb80/distinct-2-w3-2cfb80-kserve-748749867d-5tk66"]
Oct 30 23:53:48.420490 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:53:48.420452    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" path="/var/lib/kubelet/pods/009c5ba0-a19c-41b1-bcc9-94df2626188a/volumes"
Oct 30 23:54:04.151858 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:54:04.151797    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:54:34.151597 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:54:34.151556    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:54:52.747338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:52.747293    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:54:52.747916 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:52.747563    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy" containerID="cri-o://59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302" gracePeriod=30
Oct 30 23:54:54.462794 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:54.462759    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:54:54.572572 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:54.572540    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:54:58.025978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.025919    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:54:58.107521 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107492    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107532    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107562    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107610    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107708 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107686    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107727    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.107899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107802    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:54:58.107899 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107811    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.108115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107917    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.108115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107936    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:54:58.108115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107961    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:54:58.108115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.107965    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\") pod \"437c1522-65b9-4865-af16-8e681fd44b11\" (UID: \"437c1522-65b9-4865-af16-8e681fd44b11\") "
Oct 30 23:54:58.108115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108105    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:54:58.108382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108220    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:54:58.108511 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108492    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/437c1522-65b9-4865-af16-8e681fd44b11-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.108578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108517    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.108578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108532    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.108578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108547    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.108578 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.108560    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.110002 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.109979    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:54:58.110120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.110091    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:54:58.110467 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.110448    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:54:58.110645 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.110610    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg" pod "437c1522-65b9-4865-af16-8e681fd44b11" (UID: "437c1522-65b9-4865-af16-8e681fd44b11"). InnerVolumeSpecName "kube-api-access-x6djg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:54:58.127743 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.127715    6126 generic.go:356] "Generic (PLEG): container finished" podID="437c1522-65b9-4865-af16-8e681fd44b11" containerID="59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302" exitCode=0
Oct 30 23:54:58.127859 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.127775    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"
Oct 30 23:54:58.127859 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.127794    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" event={"ID":"437c1522-65b9-4865-af16-8e681fd44b11","Type":"ContainerDied","Data":"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"}
Oct 30 23:54:58.127859 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.127845    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72" event={"ID":"437c1522-65b9-4865-af16-8e681fd44b11","Type":"ContainerDied","Data":"c8964acbded0e1e888b3bf1f5c7f8eed065123dca2b6bd5ca9c968880f7f8d1c"}
Oct 30 23:54:58.128012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.127866    6126 scope.go:122] "RemoveContainer" containerID="59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"
Oct 30 23:54:58.139972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.139957    6126 scope.go:122] "RemoveContainer" containerID="59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"
Oct 30 23:54:58.140240 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:54:58.140225    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302\": container with ID starting with 59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302 not found: ID does not exist" containerID="59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"
Oct 30 23:54:58.140289 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.140248    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302"} err="failed to get container status \"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302\": rpc error: code = NotFound desc = could not find container \"59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302\": container with ID starting with 59d3d43299d9deffe1f2146113a62c4c61aae6421dd2c4daf50465a7abe9e302 not found: ID does not exist"
Oct 30 23:54:58.210340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.210307    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/437c1522-65b9-4865-af16-8e681fd44b11-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.210340 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.210342    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/437c1522-65b9-4865-af16-8e681fd44b11-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.210597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.210358    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.210597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.210373    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6djg\" (UniqueName: \"kubernetes.io/projected/437c1522-65b9-4865-af16-8e681fd44b11-kube-api-access-x6djg\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:58.310696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.310581    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:54:58.317130 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.317100    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-z8t72"]
Oct 30 23:54:58.408955 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:58.408922    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="437c1522-65b9-4865-af16-8e681fd44b11" path="/var/lib/kubelet/pods/437c1522-65b9-4865-af16-8e681fd44b11/volumes"
Oct 30 23:54:59.463151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.463116    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" podUID="c728f89a-6114-49e1-8db2-f44e93d44f1f" containerName="payload-processing" containerID="cri-o://98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e" gracePeriod=25
Oct 30 23:54:59.573570 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.573532    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing" containerID="cri-o://694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f" gracePeriod=25
Oct 30 23:54:59.753802 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.753778    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:54:59.829672 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.829636    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\" (UniqueName: \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\") pod \"c728f89a-6114-49e1-8db2-f44e93d44f1f\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") "
Oct 30 23:54:59.829895 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.829875    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\") pod \"c728f89a-6114-49e1-8db2-f44e93d44f1f\" (UID: \"c728f89a-6114-49e1-8db2-f44e93d44f1f\") "
Oct 30 23:54:59.830335 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.830296    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume" pod "c728f89a-6114-49e1-8db2-f44e93d44f1f" (UID: "c728f89a-6114-49e1-8db2-f44e93d44f1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:54:59.832036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.832012    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6" pod "c728f89a-6114-49e1-8db2-f44e93d44f1f" (UID: "c728f89a-6114-49e1-8db2-f44e93d44f1f"). InnerVolumeSpecName "kube-api-access-f9sr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:54:59.931980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.931935    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c728f89a-6114-49e1-8db2-f44e93d44f1f-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:54:59.931980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:54:59.931976    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9sr6\" (UniqueName: \"kubernetes.io/projected/c728f89a-6114-49e1-8db2-f44e93d44f1f-kube-api-access-f9sr6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:00.142991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.142889    6126 generic.go:356] "Generic (PLEG): container finished" podID="c728f89a-6114-49e1-8db2-f44e93d44f1f" containerID="98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e" exitCode=0
Oct 30 23:55:00.142991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.142948    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" event={"ID":"c728f89a-6114-49e1-8db2-f44e93d44f1f","Type":"ContainerDied","Data":"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"}
Oct 30 23:55:00.142991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.142956    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"
Oct 30 23:55:00.143282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.143031    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq" event={"ID":"c728f89a-6114-49e1-8db2-f44e93d44f1f","Type":"ContainerDied","Data":"6455ed4f43d3755893cf117cd2004f9aa831c665d5225377ce213a6b414d08c6"}
Oct 30 23:55:00.143282 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.143061    6126 scope.go:122] "RemoveContainer" containerID="98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"
Oct 30 23:55:00.154338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.154314    6126 scope.go:122] "RemoveContainer" containerID="98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"
Oct 30 23:55:00.154633 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:00.154600    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e\": container with ID starting with 98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e not found: ID does not exist" containerID="98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"
Oct 30 23:55:00.154689 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.154646    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e"} err="failed to get container status \"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e\": rpc error: code = NotFound desc = could not find container \"98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e\": container with ID starting with 98e34d90dcf72a1691016762f5a17da5a8cc686998bb8018552d679604c7a73e not found: ID does not exist"
Oct 30 23:55:00.313711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.313678    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:55:00.321605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.321577    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5e3f9d-69d999869-q7dnq"]
Oct 30 23:55:00.408117 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:00.408041    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c728f89a-6114-49e1-8db2-f44e93d44f1f" path="/var/lib/kubelet/pods/c728f89a-6114-49e1-8db2-f44e93d44f1f/volumes"
Oct 30 23:55:04.152100 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:04.152062    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:55:05.610940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:05.610903    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:06.996646 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:06.996601    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:55:06.997097 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:06.996805    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" podUID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" containerName="maas-api" containerID="cri-o://93ed885b0bffc66a8b340660fc39dac7d5c417fa4e73b24bc1678e1308451722" gracePeriod=30
Oct 30 23:55:07.194455 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.194418    6126 generic.go:356] "Generic (PLEG): container finished" podID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" containerID="93ed885b0bffc66a8b340660fc39dac7d5c417fa4e73b24bc1678e1308451722" exitCode=0
Oct 30 23:55:07.194682 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.194564    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" event={"ID":"bbdf5820-be89-45ae-9b8d-47b2f8bfde53","Type":"ContainerDied","Data":"93ed885b0bffc66a8b340660fc39dac7d5c417fa4e73b24bc1678e1308451722"}
Oct 30 23:55:07.272395 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.272372    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:55:07.332259 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.332227    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\") pod \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") "
Oct 30 23:55:07.332428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.332301    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\" (UniqueName: \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\") pod \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") "
Oct 30 23:55:07.332428 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.332374    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") pod \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") "
Oct 30 23:55:07.332553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.332458    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\") pod \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\" (UID: \"bbdf5820-be89-45ae-9b8d-47b2f8bfde53\") "
Oct 30 23:55:07.332950 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.332923    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca" pod "bbdf5820-be89-45ae-9b8d-47b2f8bfde53" (UID: "bbdf5820-be89-45ae-9b8d-47b2f8bfde53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:07.333105 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.333078    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:07.334568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.334549    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls" pod "bbdf5820-be89-45ae-9b8d-47b2f8bfde53" (UID: "bbdf5820-be89-45ae-9b8d-47b2f8bfde53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:55:07.334651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.334574    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf" pod "bbdf5820-be89-45ae-9b8d-47b2f8bfde53" (UID: "bbdf5820-be89-45ae-9b8d-47b2f8bfde53"). InnerVolumeSpecName "kube-api-access-97zbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:07.334651 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.334590    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs" pod "bbdf5820-be89-45ae-9b8d-47b2f8bfde53" (UID: "bbdf5820-be89-45ae-9b8d-47b2f8bfde53"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:55:07.434469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.434439    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:07.434469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.434469    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97zbf\" (UniqueName: \"kubernetes.io/projected/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-kube-api-access-97zbf\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:07.434706 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:07.434481    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbdf5820-be89-45ae-9b8d-47b2f8bfde53-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:08.204014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.203988    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"
Oct 30 23:55:08.204462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.203983    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m" event={"ID":"bbdf5820-be89-45ae-9b8d-47b2f8bfde53","Type":"ContainerDied","Data":"bfa18979fc65c2387f142f54a509dc3737ba571b4dc63d7f53efd6d991c34fd9"}
Oct 30 23:55:08.204462 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.204128    6126 scope.go:122] "RemoveContainer" containerID="93ed885b0bffc66a8b340660fc39dac7d5c417fa4e73b24bc1678e1308451722"
Oct 30 23:55:08.377178 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.377138    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:55:08.427339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.427308    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5e3f9d-8468b4784b-dmj6m"]
Oct 30 23:55:08.561484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:08.561452    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:55:10.407744 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:10.407708    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" path="/var/lib/kubelet/pods/bbdf5820-be89-45ae-9b8d-47b2f8bfde53/volumes"
Oct 30 23:55:15.611347 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:15.611257    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:17.144322 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:17.144287    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:55:17.144804 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:17.144526    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy" containerID="cri-o://d65993d47f94b698177a33e5f4f9cde8856217a5f743496ab171c2825e8c386f" gracePeriod=30
Oct 30 23:55:19.862704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.862677    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:55:19.900129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.900101    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\") pod \"c3295459-5ee8-464f-a807-99229d7abeb3\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") "
Oct 30 23:55:19.900299 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.900203    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\" (UniqueName: \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\") pod \"c3295459-5ee8-464f-a807-99229d7abeb3\" (UID: \"c3295459-5ee8-464f-a807-99229d7abeb3\") "
Oct 30 23:55:19.900469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.900447    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume" pod "c3295459-5ee8-464f-a807-99229d7abeb3" (UID: "c3295459-5ee8-464f-a807-99229d7abeb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:19.900590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.900575    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3295459-5ee8-464f-a807-99229d7abeb3-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:19.902520 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:19.902497    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2" pod "c3295459-5ee8-464f-a807-99229d7abeb3" (UID: "c3295459-5ee8-464f-a807-99229d7abeb3"). InnerVolumeSpecName "kube-api-access-kgkb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:20.019102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.019063    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgkb2\" (UniqueName: \"kubernetes.io/projected/c3295459-5ee8-464f-a807-99229d7abeb3-kube-api-access-kgkb2\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:20.286868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.286817    6126 generic.go:356] "Generic (PLEG): container finished" podID="c3295459-5ee8-464f-a807-99229d7abeb3" containerID="694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f" exitCode=0
Oct 30 23:55:20.286868 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.286860    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" event={"ID":"c3295459-5ee8-464f-a807-99229d7abeb3","Type":"ContainerDied","Data":"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"}
Oct 30 23:55:20.287131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.286873    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"
Oct 30 23:55:20.287131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.286908    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl" event={"ID":"c3295459-5ee8-464f-a807-99229d7abeb3","Type":"ContainerDied","Data":"7d50ebd4f397c622bb10f079b9f2617f31526e666176e95aeab83c03557b5699"}
Oct 30 23:55:20.287131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.286929    6126 scope.go:122] "RemoveContainer" containerID="694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"
Oct 30 23:55:20.298184 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.298151    6126 scope.go:122] "RemoveContainer" containerID="694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"
Oct 30 23:55:20.298458 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:20.298436    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f\": container with ID starting with 694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f not found: ID does not exist" containerID="694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"
Oct 30 23:55:20.298523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.298469    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f"} err="failed to get container status \"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f\": rpc error: code = NotFound desc = could not find container \"694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f\": container with ID starting with 694146b77e7a71fd156f23649248ab61fbfa01a2f815bff7bba5b0b35176553f not found: ID does not exist"
Oct 30 23:55:20.459369 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.459334    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:55:20.509013 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:20.508983    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5e3f9d-697c48bb67-blvnl"]
Oct 30 23:55:21.352085 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:21.352053    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:55:21.510690 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:21.510651    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:55:22.313166 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.313133    6126 generic.go:356] "Generic (PLEG): container finished" podID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerID="d65993d47f94b698177a33e5f4f9cde8856217a5f743496ab171c2825e8c386f" exitCode=0
Oct 30 23:55:22.313371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.313225    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerDied","Data":"d65993d47f94b698177a33e5f4f9cde8856217a5f743496ab171c2825e8c386f"}
Oct 30 23:55:22.313371 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.313278    6126 scope.go:122] "RemoveContainer" containerID="d796af1dace11c6efccb20156bd431ebad5376c4846522ea2e69a401bc14cb78"
Oct 30 23:55:22.408939 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.408910    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" path="/var/lib/kubelet/pods/c3295459-5ee8-464f-a807-99229d7abeb3/volumes"
Oct 30 23:55:22.424866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.424812    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:55:22.552071 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552024    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552078    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552114    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552246 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552205    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552351    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552342    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:22.552429 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552425    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552463    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552482    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:22.552597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552538    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552597 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\") pod \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\" (UID: \"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e\") "
Oct 30 23:55:22.552857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.552595    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:22.553100 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.553077    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.553195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.553104    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.553195 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.553120    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.553327 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.553161    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:22.553588 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.553565    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:22.555454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.555426    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:22.555945 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.555916    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "kube-api-access-xfjvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:22.556059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.555961    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:22.556059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.555989    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo" pod "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" (UID: "e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:55:22.654029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.653999    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.654029 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.654028    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.654245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.654041    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.654245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.654054    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfjvr\" (UniqueName: \"kubernetes.io/projected/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-kube-api-access-xfjvr\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.654245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.654066    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:22.654245 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:22.654078    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:23.321479 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.321447    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"
Oct 30 23:55:23.321712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.321478    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb" event={"ID":"e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e","Type":"ContainerDied","Data":"2b7be01dc48ce8d2e34cfb96c962b9d0b2d4d20c9464dc378d51b0d5232dab89"}
Oct 30 23:55:23.321712 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.321541    6126 scope.go:122] "RemoveContainer" containerID="d65993d47f94b698177a33e5f4f9cde8856217a5f743496ab171c2825e8c386f"
Oct 30 23:55:23.539219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.539186    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:55:23.583988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.583901    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" podUID="945fffbd-ea25-4497-9070-bd3a74573d68" containerName="main" containerID="cri-o://c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387" gracePeriod=45
Oct 30 23:55:23.591484 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.591452    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5e3f9d-openshift-default-757979d959-dn4vb"]
Oct 30 23:55:23.865177 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.865148    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:55:23.971338 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971307    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971348    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\" (UniqueName: \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971396    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971540    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971691    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\" (UniqueName: \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\") pod \"945fffbd-ea25-4497-9070-bd3a74573d68\" (UID: \"945fffbd-ea25-4497-9070-bd3a74573d68\") "
Oct 30 23:55:23.971898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971684    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:23.971898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971838    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:23.971898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.971851    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:23.972219 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.972198    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:23.972283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.972225    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:23.972283 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.972240    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:23.973970 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.973941    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:55:23.974101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.973965    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "kube-api-access-ps7fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:23.974101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:23.973986    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs" pod "945fffbd-ea25-4497-9070-bd3a74573d68" (UID: "945fffbd-ea25-4497-9070-bd3a74573d68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:55:24.073575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.073534    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps7fl\" (UniqueName: \"kubernetes.io/projected/945fffbd-ea25-4497-9070-bd3a74573d68-kube-api-access-ps7fl\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:24.073575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.073570    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/945fffbd-ea25-4497-9070-bd3a74573d68-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:24.073575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.073580    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/945fffbd-ea25-4497-9070-bd3a74573d68-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:24.330382 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.330345    6126 generic.go:356] "Generic (PLEG): container finished" podID="945fffbd-ea25-4497-9070-bd3a74573d68" containerID="c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387" exitCode=0
Oct 30 23:55:24.330590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.330394    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"
Oct 30 23:55:24.330590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.330395    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" event={"ID":"945fffbd-ea25-4497-9070-bd3a74573d68","Type":"ContainerDied","Data":"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"}
Oct 30 23:55:24.330590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.330492    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h" event={"ID":"945fffbd-ea25-4497-9070-bd3a74573d68","Type":"ContainerDied","Data":"f363e70556b76961ecf80711f160686ac9643d32de9a47f6dbda757cd40313ab"}
Oct 30 23:55:24.330590 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.330513    6126 scope.go:122] "RemoveContainer" containerID="c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"
Oct 30 23:55:24.341560 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.341542    6126 scope.go:122] "RemoveContainer" containerID="c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"
Oct 30 23:55:24.341866 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:24.341844    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387\": container with ID starting with c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387 not found: ID does not exist" containerID="c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"
Oct 30 23:55:24.341949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.341880    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387"} err="failed to get container status \"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387\": rpc error: code = NotFound desc = could not find container \"c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387\": container with ID starting with c95fd2a00d5a43132e78f0bd017cb109b71b10c9c9aa3c8113efb0f1b1eb5387 not found: ID does not exist"
Oct 30 23:55:24.407823 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.407782    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" path="/var/lib/kubelet/pods/e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e/volumes"
Oct 30 23:55:24.500133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.500101    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:55:24.504012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:24.503978    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a8204d/test-model-a8204d-kserve-568f7f67d9-lwr8h"]
Oct 30 23:55:26.352605 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.352572    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" podUID="926b8755-3dff-427f-bd1c-6daf594a4232" containerName="payload-processing" containerID="cri-o://261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60" gracePeriod=25
Oct 30 23:55:26.406835 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.406809    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="945fffbd-ea25-4497-9070-bd3a74573d68" path="/var/lib/kubelet/pods/945fffbd-ea25-4497-9070-bd3a74573d68/volumes"
Oct 30 23:55:26.511293 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.511246    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing" containerID="cri-o://deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a" gracePeriod=25
Oct 30 23:55:26.638730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.638705    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:55:26.702144 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.702110    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\" (UniqueName: \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\") pod \"926b8755-3dff-427f-bd1c-6daf594a4232\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") "
Oct 30 23:55:26.702315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.702244    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\") pod \"926b8755-3dff-427f-bd1c-6daf594a4232\" (UID: \"926b8755-3dff-427f-bd1c-6daf594a4232\") "
Oct 30 23:55:26.702609 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.702585    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume" pod "926b8755-3dff-427f-bd1c-6daf594a4232" (UID: "926b8755-3dff-427f-bd1c-6daf594a4232"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:26.704265 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.704245    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq" pod "926b8755-3dff-427f-bd1c-6daf594a4232" (UID: "926b8755-3dff-427f-bd1c-6daf594a4232"). InnerVolumeSpecName "kube-api-access-frgpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:26.803844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.803810    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frgpq\" (UniqueName: \"kubernetes.io/projected/926b8755-3dff-427f-bd1c-6daf594a4232-kube-api-access-frgpq\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:26.803844 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:26.803841    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/926b8755-3dff-427f-bd1c-6daf594a4232-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:27.357380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.357337    6126 generic.go:356] "Generic (PLEG): container finished" podID="926b8755-3dff-427f-bd1c-6daf594a4232" containerID="261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60" exitCode=0
Oct 30 23:55:27.357882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.357419    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"
Oct 30 23:55:27.357882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.357430    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" event={"ID":"926b8755-3dff-427f-bd1c-6daf594a4232","Type":"ContainerDied","Data":"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"}
Oct 30 23:55:27.357882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.357532    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r" event={"ID":"926b8755-3dff-427f-bd1c-6daf594a4232","Type":"ContainerDied","Data":"eea34f7c1c273f1d122149244ea6e25381a5f30290ddb970684a1b7e8a70eb26"}
Oct 30 23:55:27.357882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.357560    6126 scope.go:122] "RemoveContainer" containerID="261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"
Oct 30 23:55:27.368212 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.368196    6126 scope.go:122] "RemoveContainer" containerID="261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"
Oct 30 23:55:27.368503 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:27.368480    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60\": container with ID starting with 261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60 not found: ID does not exist" containerID="261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"
Oct 30 23:55:27.368555 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.368512    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60"} err="failed to get container status \"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60\": rpc error: code = NotFound desc = could not find container \"261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60\": container with ID starting with 261a41010bfb12f5ca6bc1aa188c65112df3430d022748db92c7adaf366baf60 not found: ID does not exist"
Oct 30 23:55:27.524014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.523978    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:55:27.574196 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.574155    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-71a68a-7ffd9c74b9-89k5r"]
Oct 30 23:55:27.634393 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:27.634303    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:28.408361 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:28.408327    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="926b8755-3dff-427f-bd1c-6daf594a4232" path="/var/lib/kubelet/pods/926b8755-3dff-427f-bd1c-6daf594a4232/volumes"
Oct 30 23:55:29.525760 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:29.525727    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:55:29.644477 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:29.644443    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:55:34.151203 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:34.151161    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:55:34.526773 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.526705    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" containerName="payload-processing" containerID="cri-o://99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c" gracePeriod=25
Oct 30 23:55:34.645101 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.645068    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing" containerID="cri-o://606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64" gracePeriod=25
Oct 30 23:55:34.668787 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:55:34.668762    6126 logging.go:55] [core] [Channel #5750 SubChannel #5752]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.146:50052", ServerName: "10.134.0.146:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.146:50052: connect: connection refused"
Oct 30 23:55:34.669631 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.669585    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:34.796898 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.796871    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:55:34.894931 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.894898    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\" (UniqueName: \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\") pod \"5114e2aa-0c64-447a-92a3-63da159d783f\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") "
Oct 30 23:55:34.895125 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.895035    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\") pod \"5114e2aa-0c64-447a-92a3-63da159d783f\" (UID: \"5114e2aa-0c64-447a-92a3-63da159d783f\") "
Oct 30 23:55:34.895468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.895439    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume" pod "5114e2aa-0c64-447a-92a3-63da159d783f" (UID: "5114e2aa-0c64-447a-92a3-63da159d783f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:34.897302 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.897276    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9" pod "5114e2aa-0c64-447a-92a3-63da159d783f" (UID: "5114e2aa-0c64-447a-92a3-63da159d783f"). InnerVolumeSpecName "kube-api-access-vfbr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:34.996399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.996355    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfbr9\" (UniqueName: \"kubernetes.io/projected/5114e2aa-0c64-447a-92a3-63da159d783f-kube-api-access-vfbr9\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:34.996399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:34.996390    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5114e2aa-0c64-447a-92a3-63da159d783f-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:35.411339 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.411305    6126 generic.go:356] "Generic (PLEG): container finished" podID="5114e2aa-0c64-447a-92a3-63da159d783f" containerID="99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c" exitCode=0
Oct 30 23:55:35.411858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.411344    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"
Oct 30 23:55:35.411858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.411383    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" event={"ID":"5114e2aa-0c64-447a-92a3-63da159d783f","Type":"ContainerDied","Data":"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"}
Oct 30 23:55:35.411858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.411430    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" event={"ID":"5114e2aa-0c64-447a-92a3-63da159d783f","Type":"ContainerDied","Data":"512cc44ca1eb5412bdcbf1df1ab8b2ddba13a20815e1da53ced6c8f879fc8ccd"}
Oct 30 23:55:35.411858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.411452    6126 scope.go:122] "RemoveContainer" containerID="99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"
Oct 30 23:55:35.422138 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.422119    6126 scope.go:122] "RemoveContainer" containerID="99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"
Oct 30 23:55:35.422440 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:35.422422    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c\": container with ID starting with 99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c not found: ID does not exist" containerID="99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"
Oct 30 23:55:35.422503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.422446    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c"} err="failed to get container status \"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c\": rpc error: code = NotFound desc = could not find container \"99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c\": container with ID starting with 99bf9d6d8b84d71a5739aa602f8fc13ad95d8eaf39bf922c2e3966af58fa5f4c not found: ID does not exist"
Oct 30 23:55:35.579146 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.579114    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:55:35.629698 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.629657    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2"]
Oct 30 23:55:35.669386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:35.669298    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-15b137-66f58595cc-prdf2" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.146:50052\" within 1s: context deadline exceeded"
Oct 30 23:55:36.406566 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:36.406528    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" path="/var/lib/kubelet/pods/5114e2aa-0c64-447a-92a3-63da159d783f/volumes"
Oct 30 23:55:37.633779 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:37.633743    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:44.669399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:44.669362    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:55:46.776908 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.776852    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:55:46.836102 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.836070    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\") pod \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") "
Oct 30 23:55:46.836295 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.836126    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\" (UniqueName: \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\") pod \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\" (UID: \"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9\") "
Oct 30 23:55:46.836539 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.836510    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume" pod "8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" (UID: "8e2365e7-d9ec-4cb7-bda2-4544eab4eff9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:46.836723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.836706    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:46.838380 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.838356    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h" pod "8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" (UID: "8e2365e7-d9ec-4cb7-bda2-4544eab4eff9"). InnerVolumeSpecName "kube-api-access-qsm9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:46.937725 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:46.937689    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsm9h\" (UniqueName: \"kubernetes.io/projected/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9-kube-api-access-qsm9h\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:47.488201 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.488168    6126 generic.go:356] "Generic (PLEG): container finished" podID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerID="deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a" exitCode=0
Oct 30 23:55:47.488411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.488233    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"
Oct 30 23:55:47.488411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.488345    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" event={"ID":"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9","Type":"ContainerDied","Data":"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"}
Oct 30 23:55:47.488411 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.488394    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw" event={"ID":"8e2365e7-d9ec-4cb7-bda2-4544eab4eff9","Type":"ContainerDied","Data":"1624065826ae565f6a231d73386325689716a6f549d8c20a55233bd156ce70ac"}
Oct 30 23:55:47.488596 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.488425    6126 scope.go:122] "RemoveContainer" containerID="deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"
Oct 30 23:55:47.500121 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.500099    6126 scope.go:122] "RemoveContainer" containerID="deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"
Oct 30 23:55:47.500386 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:47.500365    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a\": container with ID starting with deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a not found: ID does not exist" containerID="deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"
Oct 30 23:55:47.500464 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.500397    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a"} err="failed to get container status \"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a\": rpc error: code = NotFound desc = could not find container \"deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a\": container with ID starting with deddc779cb0a38e2d936ed2487d2276e13afa55ab3727742bb4e1820d102c76a not found: ID does not exist"
Oct 30 23:55:47.655583 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.655549    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:55:47.706444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:47.706406    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-71a68a-55b58cc74c-mz9bw"]
Oct 30 23:55:48.406938 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:48.406904    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" path="/var/lib/kubelet/pods/8e2365e7-d9ec-4cb7-bda2-4544eab4eff9/volumes"
Oct 30 23:55:54.668866 ip-10-0-133-110 kubenswrapper[6126]: W1030 23:55:54.668841    6126 logging.go:55] [core] [Channel #5815 SubChannel #5816]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.145:50052", ServerName: "10.134.0.145:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.145:50052: connect: connection refused"
Oct 30 23:55:54.923755 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:54.923688    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:55:55.031791 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.031756    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\") pod \"0d624a70-6c08-4349-ace3-a613ad7014be\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") "
Oct 30 23:55:55.031977 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.031946    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\" (UniqueName: \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\") pod \"0d624a70-6c08-4349-ace3-a613ad7014be\" (UID: \"0d624a70-6c08-4349-ace3-a613ad7014be\") "
Oct 30 23:55:55.032176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.032150    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume" pod "0d624a70-6c08-4349-ace3-a613ad7014be" (UID: "0d624a70-6c08-4349-ace3-a613ad7014be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:55.032291 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.032275    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d624a70-6c08-4349-ace3-a613ad7014be-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:55.034310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.034282    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw" pod "0d624a70-6c08-4349-ace3-a613ad7014be" (UID: "0d624a70-6c08-4349-ace3-a613ad7014be"). InnerVolumeSpecName "kube-api-access-8v9pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:55.133825 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.133790    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v9pw\" (UniqueName: \"kubernetes.io/projected/0d624a70-6c08-4349-ace3-a613ad7014be-kube-api-access-8v9pw\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:55:55.538599 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.538559    6126 generic.go:356] "Generic (PLEG): container finished" podID="0d624a70-6c08-4349-ace3-a613ad7014be" containerID="606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64" exitCode=0
Oct 30 23:55:55.540874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.538603    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:55:55.540874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.538644    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" event={"ID":"0d624a70-6c08-4349-ace3-a613ad7014be","Type":"ContainerDied","Data":"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"}
Oct 30 23:55:55.540874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.538709    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" event={"ID":"0d624a70-6c08-4349-ace3-a613ad7014be","Type":"ContainerDied","Data":"ada87543c5010fd027f643166a66b8e49fcf1c9ff3c6e2e6032e3d2f1374b875"}
Oct 30 23:55:55.540874 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.538738    6126 scope.go:122] "RemoveContainer" containerID="606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"
Oct 30 23:55:55.549579 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.549562    6126 scope.go:122] "RemoveContainer" containerID="606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"
Oct 30 23:55:55.549839 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:55:55.549822    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64\": container with ID starting with 606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64 not found: ID does not exist" containerID="606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"
Oct 30 23:55:55.549889 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.549846    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64"} err="failed to get container status \"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64\": rpc error: code = NotFound desc = could not find container \"606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64\": container with ID starting with 606600b8b64a77d217cc700fc201872a90b01d9ae2b2ce08ec042b5ad09fea64 not found: ID does not exist"
Oct 30 23:55:55.669537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.669494    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.145:50052\" within 1s: context deadline exceeded"
Oct 30 23:55:55.670031 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.669605    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"
Oct 30 23:55:55.711454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.711419    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:55:55.720036 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:55.720008    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-15b137-6964cf5467-2jdbw"]
Oct 30 23:55:56.409090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:55:56.409049    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" path="/var/lib/kubelet/pods/0d624a70-6c08-4349-ace3-a613ad7014be/volumes"
Oct 30 23:56:02.917162 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:02.917130    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:56:02.917634 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:02.917348    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" podUID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" containerName="maas-api" containerID="cri-o://d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946" gracePeriod=30
Oct 30 23:56:03.206287 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.206259    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:56:03.333716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.333682    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\") pod \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") "
Oct 30 23:56:03.334115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.333759    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\" (UniqueName: \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\") pod \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") "
Oct 30 23:56:03.334115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.333973    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\") pod \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") "
Oct 30 23:56:03.334115 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.334060    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\") pod \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\" (UID: \"2bcd11cc-7a60-465d-8c5a-5a27ecf43600\") "
Oct 30 23:56:03.335387 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.335356    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca" pod "2bcd11cc-7a60-465d-8c5a-5a27ecf43600" (UID: "2bcd11cc-7a60-465d-8c5a-5a27ecf43600"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:03.337928 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.337861    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls" pod "2bcd11cc-7a60-465d-8c5a-5a27ecf43600" (UID: "2bcd11cc-7a60-465d-8c5a-5a27ecf43600"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:03.340014 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.339524    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5" pod "2bcd11cc-7a60-465d-8c5a-5a27ecf43600" (UID: "2bcd11cc-7a60-465d-8c5a-5a27ecf43600"). InnerVolumeSpecName "kube-api-access-v29n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:03.344763 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.344735    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs" pod "2bcd11cc-7a60-465d-8c5a-5a27ecf43600" (UID: "2bcd11cc-7a60-465d-8c5a-5a27ecf43600"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:03.435878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.435805    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:03.435878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.435838    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:03.435878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.435847    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:03.435878 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.435856    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v29n5\" (UniqueName: \"kubernetes.io/projected/2bcd11cc-7a60-465d-8c5a-5a27ecf43600-kube-api-access-v29n5\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:03.589051 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.589016    6126 generic.go:356] "Generic (PLEG): container finished" podID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" containerID="d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946" exitCode=0
Oct 30 23:56:03.589234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.589063    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"
Oct 30 23:56:03.589234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.589104    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" event={"ID":"2bcd11cc-7a60-465d-8c5a-5a27ecf43600","Type":"ContainerDied","Data":"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"}
Oct 30 23:56:03.589234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.589159    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk" event={"ID":"2bcd11cc-7a60-465d-8c5a-5a27ecf43600","Type":"ContainerDied","Data":"559107de904831bc679b2fc2523812b57fec5e6f711fac1933685897d1add77f"}
Oct 30 23:56:03.589234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.589184    6126 scope.go:122] "RemoveContainer" containerID="d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"
Oct 30 23:56:03.600679 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.600659    6126 scope.go:122] "RemoveContainer" containerID="d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"
Oct 30 23:56:03.601065 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:03.601041    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946\": container with ID starting with d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946 not found: ID does not exist" containerID="d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"
Oct 30 23:56:03.601157 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.601075    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946"} err="failed to get container status \"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946\": rpc error: code = NotFound desc = could not find container \"d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946\": container with ID starting with d746a64953eea93221f139635c85061abaea62f47de8d14210be4993e9976946 not found: ID does not exist"
Oct 30 23:56:03.759444 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.759403    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:56:03.761602 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:03.761575    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-71a68a-7d765cbd8-mz4fk"]
Oct 30 23:56:04.157075 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:04.156992    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:56:04.406998 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:04.406962    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" path="/var/lib/kubelet/pods/2bcd11cc-7a60-465d-8c5a-5a27ecf43600/volumes"
Oct 30 23:56:12.053707 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:12.053674    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:56:12.054240 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:12.054001    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" containerID="cri-o://93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113" gracePeriod=30
Oct 30 23:56:14.871723 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:14.871674    6126 patch_prober.go:29] interesting pod/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:56:14.872158 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:14.871766    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:56:17.354711 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.354678    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:56:17.397716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397684    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.397716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397719    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.397935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397760    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.397935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397819    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.397935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397852    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.397935 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397885    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.398149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397962    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.398149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.397999    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.398149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398048    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:56:17.398149 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398060    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\") pod \"469a8266-5df9-4623-8d6e-a437879fd800\" (UID: \"469a8266-5df9-4623-8d6e-a437879fd800\") "
Oct 30 23:56:17.398451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398218    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:56:17.398451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398268    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:17.398451 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398415    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:56:17.398826 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.398426    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:56:17.399554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.399516    6126 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-credential-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.399554 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.399548    6126 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-socket\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.399771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.399562    6126 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-data\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.399771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.399578    6126 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-workload-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.399771 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.399592    6126 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469a8266-5df9-4623-8d6e-a437879fd800-istiod-ca-cert\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.400310 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.400284    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:56:17.400734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.400713    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:56:17.401041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.401014    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "kube-api-access-4vxcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:17.401147 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.401052    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token" pod "469a8266-5df9-4623-8d6e-a437879fd800" (UID: "469a8266-5df9-4623-8d6e-a437879fd800"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:17.500753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.500719    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vxcx\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-kube-api-access-4vxcx\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.500753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.500750    6126 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469a8266-5df9-4623-8d6e-a437879fd800-istio-token\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.500753 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.500759    6126 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469a8266-5df9-4623-8d6e-a437879fd800-istio-envoy\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.501072 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.500768    6126 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469a8266-5df9-4623-8d6e-a437879fd800-istio-podinfo\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:17.684704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.684590    6126 generic.go:356] "Generic (PLEG): container finished" podID="469a8266-5df9-4623-8d6e-a437879fd800" containerID="93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113" exitCode=0
Oct 30 23:56:17.684704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.684666    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"
Oct 30 23:56:17.684704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.684676    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" event={"ID":"469a8266-5df9-4623-8d6e-a437879fd800","Type":"ContainerDied","Data":"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"}
Oct 30 23:56:17.684976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.684741    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26" event={"ID":"469a8266-5df9-4623-8d6e-a437879fd800","Type":"ContainerDied","Data":"5d3f6f52d375660a0cb6fee335b56b64484f92acb7058c24b06a37956d95fbbe"}
Oct 30 23:56:17.684976 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.684759    6126 scope.go:122] "RemoveContainer" containerID="93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"
Oct 30 23:56:17.697532 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.697513    6126 scope.go:122] "RemoveContainer" containerID="93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"
Oct 30 23:56:17.698388 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:17.697885    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113\": container with ID starting with 93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113 not found: ID does not exist" containerID="93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"
Oct 30 23:56:17.698388 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.697917    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113"} err="failed to get container status \"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113\": rpc error: code = NotFound desc = could not find container \"93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113\": container with ID starting with 93a8793ac410962e0775397e3e1a6ddc20f662c62398a7e7d5fa665972dd2113 not found: ID does not exist"
Oct 30 23:56:17.859632 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.859583    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:56:17.866628 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:17.866589    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-71a68a-openshift-default-7bf49f766c-gqf26"]
Oct 30 23:56:18.409576 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:18.409545    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="469a8266-5df9-4623-8d6e-a437879fd800" path="/var/lib/kubelet/pods/469a8266-5df9-4623-8d6e-a437879fd800/volumes"
Oct 30 23:56:26.055817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.055771    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:56:26.056330 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.056031    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerName="maas-api" containerID="cri-o://b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75" gracePeriod=30
Oct 30 23:56:26.322990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.322925    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:56:26.406194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406156    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\") pod \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") "
Oct 30 23:56:26.406375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406261    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\") pod \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") "
Oct 30 23:56:26.406375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406339    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") pod \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") "
Oct 30 23:56:26.406476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406432    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\" (UniqueName: \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\") pod \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\" (UID: \"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c\") "
Oct 30 23:56:26.406713 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406677    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca" pod "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" (UID: "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:26.406875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.406855    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:26.408633 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.408596    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls" pod "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" (UID: "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:26.408840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.408823    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs" pod "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" (UID: "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:26.408840 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.408829    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6" pod "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" (UID: "dea6d8a3-e3d3-4599-91f0-345e35b9bd6c"). InnerVolumeSpecName "kube-api-access-plsm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:26.508311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.508271    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:26.508311 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.508311    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:26.508568 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.508326    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plsm6\" (UniqueName: \"kubernetes.io/projected/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c-kube-api-access-plsm6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:26.521610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.521582    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:56:26.579676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.579589    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:56:26.743888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.743852    6126 generic.go:356] "Generic (PLEG): container finished" podID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerID="b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75" exitCode=0
Oct 30 23:56:26.744106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.743905    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"
Oct 30 23:56:26.744106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.743938    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" event={"ID":"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c","Type":"ContainerDied","Data":"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"}
Oct 30 23:56:26.744106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.744000    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" event={"ID":"dea6d8a3-e3d3-4599-91f0-345e35b9bd6c","Type":"ContainerDied","Data":"ab6ac030420aab545d0947f27abb08a54d42075ac430afff88de3968d9fb2975"}
Oct 30 23:56:26.744106 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.744030    6126 scope.go:122] "RemoveContainer" containerID="b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"
Oct 30 23:56:26.755129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.755108    6126 scope.go:122] "RemoveContainer" containerID="b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"
Oct 30 23:56:26.755393 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:26.755371    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75\": container with ID starting with b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75 not found: ID does not exist" containerID="b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"
Oct 30 23:56:26.755463 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.755401    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75"} err="failed to get container status \"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75\": rpc error: code = NotFound desc = could not find container \"b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75\": container with ID starting with b39d7f0030f6949b460397dc69bdd67bd54a13e649dba874097416f9b9cbcf75 not found: ID does not exist"
Oct 30 23:56:26.876997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.876914    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:56:26.880940 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:26.880910    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb"]
Oct 30 23:56:28.407937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:28.407896    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" path="/var/lib/kubelet/pods/dea6d8a3-e3d3-4599-91f0-345e35b9bd6c/volumes"
Oct 30 23:56:29.257829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:29.257785    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-fb14dc-58878fc678-vr6qb" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.107:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:56:31.522845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.522779    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" podUID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" containerName="payload-processing" containerID="cri-o://a018ea9b19ef7a033a67a8fc13031d0a7355edfc10c93e2ee4fab14dba93e433" gracePeriod=25
Oct 30 23:56:31.580317 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.580283    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" podUID="be2e6889-92fb-45fb-aebd-f952c437cfd4" containerName="payload-pre-processing" containerID="cri-o://063e8f3b102c2a78b0717073b8b944142b41d54b22ec6464b04c08244fd55371" gracePeriod=25
Oct 30 23:56:31.782515 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.782424    6126 generic.go:356] "Generic (PLEG): container finished" podID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" containerID="a018ea9b19ef7a033a67a8fc13031d0a7355edfc10c93e2ee4fab14dba93e433" exitCode=0
Oct 30 23:56:31.782905 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.782745    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" event={"ID":"ef44ff58-5f3c-4b09-9915-655beae5ee4d","Type":"ContainerDied","Data":"a018ea9b19ef7a033a67a8fc13031d0a7355edfc10c93e2ee4fab14dba93e433"}
Oct 30 23:56:31.785473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.785343    6126 generic.go:356] "Generic (PLEG): container finished" podID="be2e6889-92fb-45fb-aebd-f952c437cfd4" containerID="063e8f3b102c2a78b0717073b8b944142b41d54b22ec6464b04c08244fd55371" exitCode=0
Oct 30 23:56:31.785473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.785392    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" event={"ID":"be2e6889-92fb-45fb-aebd-f952c437cfd4","Type":"ContainerDied","Data":"063e8f3b102c2a78b0717073b8b944142b41d54b22ec6464b04c08244fd55371"}
Oct 30 23:56:31.874313 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.873957    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:56:31.919730 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.919706    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:56:31.971872 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.971834    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\") pod \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") "
Oct 30 23:56:31.972018 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.971972    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\" (UniqueName: \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\") pod \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\" (UID: \"ef44ff58-5f3c-4b09-9915-655beae5ee4d\") "
Oct 30 23:56:31.972268 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.972246    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume" pod "ef44ff58-5f3c-4b09-9915-655beae5ee4d" (UID: "ef44ff58-5f3c-4b09-9915-655beae5ee4d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:31.972366 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.972351    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef44ff58-5f3c-4b09-9915-655beae5ee4d-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:31.974241 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:31.974219    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb" pod "ef44ff58-5f3c-4b09-9915-655beae5ee4d" (UID: "ef44ff58-5f3c-4b09-9915-655beae5ee4d"). InnerVolumeSpecName "kube-api-access-xzlrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:32.073430 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.073351    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\" (UniqueName: \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\") pod \"be2e6889-92fb-45fb-aebd-f952c437cfd4\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") "
Oct 30 23:56:32.073654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.073437    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\") pod \"be2e6889-92fb-45fb-aebd-f952c437cfd4\" (UID: \"be2e6889-92fb-45fb-aebd-f952c437cfd4\") "
Oct 30 23:56:32.073895 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.073869    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume" pod "be2e6889-92fb-45fb-aebd-f952c437cfd4" (UID: "be2e6889-92fb-45fb-aebd-f952c437cfd4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:32.073967 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.073939    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzlrb\" (UniqueName: \"kubernetes.io/projected/ef44ff58-5f3c-4b09-9915-655beae5ee4d-kube-api-access-xzlrb\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:32.075541 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.075518    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh" pod "be2e6889-92fb-45fb-aebd-f952c437cfd4" (UID: "be2e6889-92fb-45fb-aebd-f952c437cfd4"). InnerVolumeSpecName "kube-api-access-622kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:32.175436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.175399    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-622kh\" (UniqueName: \"kubernetes.io/projected/be2e6889-92fb-45fb-aebd-f952c437cfd4-kube-api-access-622kh\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:32.175436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.175430    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be2e6889-92fb-45fb-aebd-f952c437cfd4-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:32.793345 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.793316    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"
Oct 30 23:56:32.793838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.793357    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc" event={"ID":"ef44ff58-5f3c-4b09-9915-655beae5ee4d","Type":"ContainerDied","Data":"ecff97f73925f9a710ffecbcea7b9646f9547a3f7fed3e2e0a7ba53d07b8642b"}
Oct 30 23:56:32.793838 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.793427    6126 scope.go:122] "RemoveContainer" containerID="a018ea9b19ef7a033a67a8fc13031d0a7355edfc10c93e2ee4fab14dba93e433"
Oct 30 23:56:32.794897 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.794879    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"
Oct 30 23:56:32.794988 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.794882    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7" event={"ID":"be2e6889-92fb-45fb-aebd-f952c437cfd4","Type":"ContainerDied","Data":"24bc7a5e9f3befa3d0ac9a5124b3c418cf805561a67822e855ee0dd5fbd4156f"}
Oct 30 23:56:32.803094 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.803078    6126 scope.go:122] "RemoveContainer" containerID="063e8f3b102c2a78b0717073b8b944142b41d54b22ec6464b04c08244fd55371"
Oct 30 23:56:32.960537 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:32.960502    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:56:33.013281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:33.013246    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w6-fb14dc-6b75bdc7bc-x7bf7"]
Oct 30 23:56:33.126032 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:33.125923    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:56:33.128281 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:33.128254    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w6-fb14dc-54f567b69c-wsccc"]
Oct 30 23:56:34.151557 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:34.151516    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:56:34.408654 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:34.408549    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be2e6889-92fb-45fb-aebd-f952c437cfd4" path="/var/lib/kubelet/pods/be2e6889-92fb-45fb-aebd-f952c437cfd4/volumes"
Oct 30 23:56:34.408966 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:34.408951    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" path="/var/lib/kubelet/pods/ef44ff58-5f3c-4b09-9915-655beae5ee4d/volumes"
Oct 30 23:56:47.670546 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:47.670464    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:56:50.253993 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:50.253955    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:56:50.367148 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:50.367112    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:56:52.671030 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.670975    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" podUID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" containerName="payload-processing" containerID="cri-o://fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e" gracePeriod=25
Oct 30 23:56:52.924238 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.924176    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:56:52.928145 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.928119    6126 generic.go:356] "Generic (PLEG): container finished" podID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" containerID="fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e" exitCode=0
Oct 30 23:56:52.928271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.928157    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"
Oct 30 23:56:52.928271 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.928209    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" event={"ID":"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4","Type":"ContainerDied","Data":"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"}
Oct 30 23:56:52.928399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.928275    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28" event={"ID":"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4","Type":"ContainerDied","Data":"a7b0f3c38e395a05ced6101e8dfa0aa4f0e85a7f6a518e5b5c9e6e3b0a3f239e"}
Oct 30 23:56:52.928399 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.928306    6126 scope.go:122] "RemoveContainer" containerID="fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"
Oct 30 23:56:52.937667 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.937650    6126 scope.go:122] "RemoveContainer" containerID="fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"
Oct 30 23:56:52.937968 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:52.937948    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e\": container with ID starting with fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e not found: ID does not exist" containerID="fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"
Oct 30 23:56:52.938041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:52.937979    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e"} err="failed to get container status \"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e\": rpc error: code = NotFound desc = could not find container \"fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e\": container with ID starting with fa7282735927c54b313b36b9b7e9ea8dac779f5b03f4b72b2abce05521a20a2e not found: ID does not exist"
Oct 30 23:56:53.009004 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.008970    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\") pod \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") "
Oct 30 23:56:53.009176 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.009163    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\" (UniqueName: \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\") pod \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\" (UID: \"fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4\") "
Oct 30 23:56:53.009368 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.009346    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume" pod "fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" (UID: "fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:53.009478 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.009465    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:53.011580 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.011555    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85" pod "fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" (UID: "fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4"). InnerVolumeSpecName "kube-api-access-bgd85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:53.110739 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.110708    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgd85\" (UniqueName: \"kubernetes.io/projected/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4-kube-api-access-bgd85\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:53.361190 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.361157    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:56:53.365265 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:53.365234    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-276bec-58fcd5fd9f-gnb28"]
Oct 30 23:56:54.407151 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:54.407114    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" path="/var/lib/kubelet/pods/fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4/volumes"
Oct 30 23:56:55.254503 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.254462    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" podUID="f790bb6f-2b36-4429-b521-899f9327de51" containerName="payload-processing" containerID="cri-o://83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a" gracePeriod=25
Oct 30 23:56:55.368076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.368014    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" podUID="a6f85f95-17f2-40c7-86e4-35267308c14a" containerName="payload-pre-processing" containerID="cri-o://46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d" gracePeriod=25
Oct 30 23:56:55.529871 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.529843    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:56:55.640440 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.640410    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\") pod \"f790bb6f-2b36-4429-b521-899f9327de51\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") "
Oct 30 23:56:55.640584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.640543    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\" (UniqueName: \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\") pod \"f790bb6f-2b36-4429-b521-899f9327de51\" (UID: \"f790bb6f-2b36-4429-b521-899f9327de51\") "
Oct 30 23:56:55.640829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.640801    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume" pod "f790bb6f-2b36-4429-b521-899f9327de51" (UID: "f790bb6f-2b36-4429-b521-899f9327de51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:55.641068 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.641043    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f790bb6f-2b36-4429-b521-899f9327de51-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:55.643161 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.643141    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54" pod "f790bb6f-2b36-4429-b521-899f9327de51" (UID: "f790bb6f-2b36-4429-b521-899f9327de51"). InnerVolumeSpecName "kube-api-access-k4f54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:55.643748 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.643731    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:56:55.741762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.741725    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\") pod \"a6f85f95-17f2-40c7-86e4-35267308c14a\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") "
Oct 30 23:56:55.741957 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.741796    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\" (UniqueName: \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\") pod \"a6f85f95-17f2-40c7-86e4-35267308c14a\" (UID: \"a6f85f95-17f2-40c7-86e4-35267308c14a\") "
Oct 30 23:56:55.742079 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.742056    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume" pod "a6f85f95-17f2-40c7-86e4-35267308c14a" (UID: "a6f85f95-17f2-40c7-86e4-35267308c14a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:55.742278 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.742263    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6f85f95-17f2-40c7-86e4-35267308c14a-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:55.742314 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.742282    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4f54\" (UniqueName: \"kubernetes.io/projected/f790bb6f-2b36-4429-b521-899f9327de51-kube-api-access-k4f54\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:55.743965 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.743944    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs" pod "a6f85f95-17f2-40c7-86e4-35267308c14a" (UID: "a6f85f95-17f2-40c7-86e4-35267308c14a"). InnerVolumeSpecName "kube-api-access-6pfbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:55.843003 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.842926    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pfbs\" (UniqueName: \"kubernetes.io/projected/a6f85f95-17f2-40c7-86e4-35267308c14a-kube-api-access-6pfbs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:55.947659 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.947597    6126 generic.go:356] "Generic (PLEG): container finished" podID="a6f85f95-17f2-40c7-86e4-35267308c14a" containerID="46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d" exitCode=0
Oct 30 23:56:55.947829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.947668    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"
Oct 30 23:56:55.947829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.947663    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" event={"ID":"a6f85f95-17f2-40c7-86e4-35267308c14a","Type":"ContainerDied","Data":"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"}
Oct 30 23:56:55.947829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.947791    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl" event={"ID":"a6f85f95-17f2-40c7-86e4-35267308c14a","Type":"ContainerDied","Data":"108de051ac58c820cfc232a02f68ce8719833925defc6ded732e7ad24358294b"}
Oct 30 23:56:55.947829 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.947813    6126 scope.go:122] "RemoveContainer" containerID="46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"
Oct 30 23:56:55.949077 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.949051    6126 generic.go:356] "Generic (PLEG): container finished" podID="f790bb6f-2b36-4429-b521-899f9327de51" containerID="83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a" exitCode=0
Oct 30 23:56:55.949197 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.949089    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"
Oct 30 23:56:55.949265 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.949187    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" event={"ID":"f790bb6f-2b36-4429-b521-899f9327de51","Type":"ContainerDied","Data":"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"}
Oct 30 23:56:55.949265 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.949237    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c" event={"ID":"f790bb6f-2b36-4429-b521-899f9327de51","Type":"ContainerDied","Data":"dd77dcbcd82d76bad1f8a8bc6e3c51c757a1b4ce9f4a40184ec13fb3fecfaa97"}
Oct 30 23:56:55.957365 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.957342    6126 scope.go:122] "RemoveContainer" containerID="46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"
Oct 30 23:56:55.957672 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:55.957646    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d\": container with ID starting with 46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d not found: ID does not exist" containerID="46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"
Oct 30 23:56:55.957778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.957681    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d"} err="failed to get container status \"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d\": rpc error: code = NotFound desc = could not find container \"46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d\": container with ID starting with 46e943e9aaa7d8ae369133da7bbe9cbeac9385fd3eeb39a8300a9bad5601784d not found: ID does not exist"
Oct 30 23:56:55.957778 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.957705    6126 scope.go:122] "RemoveContainer" containerID="83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"
Oct 30 23:56:55.968033 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.968014    6126 scope.go:122] "RemoveContainer" containerID="83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"
Oct 30 23:56:55.968293 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:55.968273    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a\": container with ID starting with 83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a not found: ID does not exist" containerID="83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"
Oct 30 23:56:55.968354 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:55.968300    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a"} err="failed to get container status \"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a\": rpc error: code = NotFound desc = could not find container \"83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a\": container with ID starting with 83e7c0cf80db25a7285bc37c132b2501e2e5bf2c82a131b3490a600592f6b27a not found: ID does not exist"
Oct 30 23:56:56.116133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.116033    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:56:56.121777 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.121750    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w6-3be34b-f97f87bc7-cd58c"]
Oct 30 23:56:56.235439 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.235380    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:56:56.238017 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.237987    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w6-3be34b-cc9ff495-nllzl"]
Oct 30 23:56:56.406657 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.406550    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6f85f95-17f2-40c7-86e4-35267308c14a" path="/var/lib/kubelet/pods/a6f85f95-17f2-40c7-86e4-35267308c14a/volumes"
Oct 30 23:56:56.406972 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:56.406958    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f790bb6f-2b36-4429-b521-899f9327de51" path="/var/lib/kubelet/pods/f790bb6f-2b36-4429-b521-899f9327de51/volumes"
Oct 30 23:56:57.926090 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:57.926055    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:56:57.926487 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:57.926267    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" podUID="13754fbe-0637-4b95-9d95-6302fc13b446" containerName="maas-api" containerID="cri-o://2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67" gracePeriod=30
Oct 30 23:56:58.186397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.186336    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:56:58.273817 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.273781    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") pod \"13754fbe-0637-4b95-9d95-6302fc13b446\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") "
Oct 30 23:56:58.273990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.273842    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\") pod \"13754fbe-0637-4b95-9d95-6302fc13b446\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") "
Oct 30 23:56:58.273990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.273936    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\" (UniqueName: \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\") pod \"13754fbe-0637-4b95-9d95-6302fc13b446\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") "
Oct 30 23:56:58.273990 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.273984    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\") pod \"13754fbe-0637-4b95-9d95-6302fc13b446\" (UID: \"13754fbe-0637-4b95-9d95-6302fc13b446\") "
Oct 30 23:56:58.274250 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.274223    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca" pod "13754fbe-0637-4b95-9d95-6302fc13b446" (UID: "13754fbe-0637-4b95-9d95-6302fc13b446"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:58.274460 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.274434    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13754fbe-0637-4b95-9d95-6302fc13b446-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:58.275942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.275921    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls" pod "13754fbe-0637-4b95-9d95-6302fc13b446" (UID: "13754fbe-0637-4b95-9d95-6302fc13b446"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:58.276192 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.276164    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs" pod "13754fbe-0637-4b95-9d95-6302fc13b446" (UID: "13754fbe-0637-4b95-9d95-6302fc13b446"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:58.276412 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.276311    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq" pod "13754fbe-0637-4b95-9d95-6302fc13b446" (UID: "13754fbe-0637-4b95-9d95-6302fc13b446"). InnerVolumeSpecName "kube-api-access-d27cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:58.375634 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.375597    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d27cq\" (UniqueName: \"kubernetes.io/projected/13754fbe-0637-4b95-9d95-6302fc13b446-kube-api-access-d27cq\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:58.375803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.375647    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:58.375803 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.375660    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13754fbe-0637-4b95-9d95-6302fc13b446-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:56:58.976454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.976421    6126 generic.go:356] "Generic (PLEG): container finished" podID="13754fbe-0637-4b95-9d95-6302fc13b446" containerID="2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67" exitCode=0
Oct 30 23:56:58.976991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.976491    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"
Oct 30 23:56:58.976991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.976519    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" event={"ID":"13754fbe-0637-4b95-9d95-6302fc13b446","Type":"ContainerDied","Data":"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"}
Oct 30 23:56:58.976991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.976589    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls" event={"ID":"13754fbe-0637-4b95-9d95-6302fc13b446","Type":"ContainerDied","Data":"dd0a6dbeb5395a5c6bf679802a60e10ab62ddbc204ff065a67b0ae41f86afcc5"}
Oct 30 23:56:58.976991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.976627    6126 scope.go:122] "RemoveContainer" containerID="2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"
Oct 30 23:56:58.986544 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.986521    6126 scope.go:122] "RemoveContainer" containerID="2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"
Oct 30 23:56:58.986856 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:56:58.986833    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67\": container with ID starting with 2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67 not found: ID does not exist" containerID="2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"
Oct 30 23:56:58.986975 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:58.986861    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67"} err="failed to get container status \"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67\": rpc error: code = NotFound desc = could not find container \"2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67\": container with ID starting with 2165e432f032313a7c44fbfa816d75dcf8bc34b1661b9dc968f79671be3c7c67 not found: ID does not exist"
Oct 30 23:56:59.152754 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:59.152716    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:56:59.204009 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:56:59.203968    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-276bec-86b9f6fb99-x58ls"]
Oct 30 23:57:00.406775 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:00.406738    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13754fbe-0637-4b95-9d95-6302fc13b446" path="/var/lib/kubelet/pods/13754fbe-0637-4b95-9d95-6302fc13b446/volumes"
Oct 30 23:57:04.151697 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:04.151660    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:57:05.853473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:05.853439    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:57:05.853943 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:05.853655    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" podUID="45625647-4456-4f40-b907-95ee1e9b5615" containerName="maas-api" containerID="cri-o://1bcac0b29e96ac7b574f4317eccd9284bae1fba1dd3b227ca12d6b2173754143" gracePeriod=30
Oct 30 23:57:06.026504 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.026473    6126 generic.go:356] "Generic (PLEG): container finished" podID="45625647-4456-4f40-b907-95ee1e9b5615" containerID="1bcac0b29e96ac7b574f4317eccd9284bae1fba1dd3b227ca12d6b2173754143" exitCode=0
Oct 30 23:57:06.026736 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.026540    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" event={"ID":"45625647-4456-4f40-b907-95ee1e9b5615","Type":"ContainerDied","Data":"1bcac0b29e96ac7b574f4317eccd9284bae1fba1dd3b227ca12d6b2173754143"}
Oct 30 23:57:06.127586 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.127561    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:57:06.161342 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.161313    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\" (UniqueName: \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\") pod \"45625647-4456-4f40-b907-95ee1e9b5615\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") "
Oct 30 23:57:06.161493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.161367    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\") pod \"45625647-4456-4f40-b907-95ee1e9b5615\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") "
Oct 30 23:57:06.161493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.161445    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\") pod \"45625647-4456-4f40-b907-95ee1e9b5615\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") "
Oct 30 23:57:06.161493 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.161469    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") pod \"45625647-4456-4f40-b907-95ee1e9b5615\" (UID: \"45625647-4456-4f40-b907-95ee1e9b5615\") "
Oct 30 23:57:06.161888 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.161862    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca" pod "45625647-4456-4f40-b907-95ee1e9b5615" (UID: "45625647-4456-4f40-b907-95ee1e9b5615"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:06.163608 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.163582    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs" pod "45625647-4456-4f40-b907-95ee1e9b5615" (UID: "45625647-4456-4f40-b907-95ee1e9b5615"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:06.163715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.163647    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv" pod "45625647-4456-4f40-b907-95ee1e9b5615" (UID: "45625647-4456-4f40-b907-95ee1e9b5615"). InnerVolumeSpecName "kube-api-access-264wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:06.163715 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.163690    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls" pod "45625647-4456-4f40-b907-95ee1e9b5615" (UID: "45625647-4456-4f40-b907-95ee1e9b5615"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:06.262653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.262602    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-264wv\" (UniqueName: \"kubernetes.io/projected/45625647-4456-4f40-b907-95ee1e9b5615-kube-api-access-264wv\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:06.262653 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.262655    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:06.262869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.262671    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45625647-4456-4f40-b907-95ee1e9b5615-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:06.262869 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:06.262686    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45625647-4456-4f40-b907-95ee1e9b5615-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:07.034198 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:07.034165    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk" event={"ID":"45625647-4456-4f40-b907-95ee1e9b5615","Type":"ContainerDied","Data":"bf2ec8f93f6525a33921a8c2ca01e68d374ae8a2978247f6778cf7e1078e7757"}
Oct 30 23:57:07.034198 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:07.034193    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"
Oct 30 23:57:07.034782 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:07.034226    6126 scope.go:122] "RemoveContainer" containerID="1bcac0b29e96ac7b574f4317eccd9284bae1fba1dd3b227ca12d6b2173754143"
Oct 30 23:57:07.214397 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:07.214363    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:57:07.263630 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:07.263595    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-3be34b-84d8867b7b-f9mtk"]
Oct 30 23:57:08.406443 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:08.406410    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45625647-4456-4f40-b907-95ee1e9b5615" path="/var/lib/kubelet/pods/45625647-4456-4f40-b907-95ee1e9b5615/volumes"
Oct 30 23:57:09.014845 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:09.014810    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:57:09.033949 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:09.033927    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 30 23:57:20.054636 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:20.054590    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:57:20.165300 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:20.165260    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:57:20.825785 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:20.825754    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:57:25.055942 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.055884    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" podUID="9dde2edb-297e-4c3c-b4b2-64e931435460" containerName="payload-processing" containerID="cri-o://b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c" gracePeriod=25
Oct 30 23:57:25.166538 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.166500    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing" containerID="cri-o://19398d019a3526704e4be1e9a99232df4c62ab5f7500589c9e3610870d818548" gracePeriod=25
Oct 30 23:57:25.330516 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.330491    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:57:25.474875 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.474845    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\") pod \"9dde2edb-297e-4c3c-b4b2-64e931435460\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") "
Oct 30 23:57:25.475083 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.475064    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\" (UniqueName: \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\") pod \"9dde2edb-297e-4c3c-b4b2-64e931435460\" (UID: \"9dde2edb-297e-4c3c-b4b2-64e931435460\") "
Oct 30 23:57:25.475315 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.475289    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume" pod "9dde2edb-297e-4c3c-b4b2-64e931435460" (UID: "9dde2edb-297e-4c3c-b4b2-64e931435460"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:25.475527 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.475497    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dde2edb-297e-4c3c-b4b2-64e931435460-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:25.477319 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.477297    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6" pod "9dde2edb-297e-4c3c-b4b2-64e931435460" (UID: "9dde2edb-297e-4c3c-b4b2-64e931435460"). InnerVolumeSpecName "kube-api-access-ctpz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:25.576573 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:25.576467    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctpz6\" (UniqueName: \"kubernetes.io/projected/9dde2edb-297e-4c3c-b4b2-64e931435460-kube-api-access-ctpz6\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:26.157301 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.157260    6126 generic.go:356] "Generic (PLEG): container finished" podID="9dde2edb-297e-4c3c-b4b2-64e931435460" containerID="b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c" exitCode=0
Oct 30 23:57:26.157797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.157312    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"
Oct 30 23:57:26.157797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.157321    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" event={"ID":"9dde2edb-297e-4c3c-b4b2-64e931435460","Type":"ContainerDied","Data":"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"}
Oct 30 23:57:26.157797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.157363    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5" event={"ID":"9dde2edb-297e-4c3c-b4b2-64e931435460","Type":"ContainerDied","Data":"3c7a47a2450318a095b245a7eee04e1c600d6445f32b175a8fbf7c14b623fbf5"}
Oct 30 23:57:26.157797 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.157384    6126 scope.go:122] "RemoveContainer" containerID="b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"
Oct 30 23:57:26.167140 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.167123    6126 scope.go:122] "RemoveContainer" containerID="b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"
Oct 30 23:57:26.167409 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:26.167391    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c\": container with ID starting with b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c not found: ID does not exist" containerID="b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"
Oct 30 23:57:26.167454 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.167418    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c"} err="failed to get container status \"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c\": rpc error: code = NotFound desc = could not find container \"b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c\": container with ID starting with b27af94d2b50ecfe3dce15e020e4556009da2af32daac22d679d5c463addd59c not found: ID does not exist"
Oct 30 23:57:26.329139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.329109    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:57:26.379223 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.379191    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-333b59-79fcc69d89-n2tm5"]
Oct 30 23:57:26.407041 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:26.407010    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dde2edb-297e-4c3c-b4b2-64e931435460" path="/var/lib/kubelet/pods/9dde2edb-297e-4c3c-b4b2-64e931435460/volumes"
Oct 30 23:57:28.328242 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.328207    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:57:28.329144 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.329088    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" podUID="612aa55a-a6c7-4482-9303-ddcdda725d9e" containerName="maas-api" containerID="cri-o://35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f" gracePeriod=30
Oct 30 23:57:28.593861 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.593801    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:57:28.715386 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.715340    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\") pod \"612aa55a-a6c7-4482-9303-ddcdda725d9e\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") "
Oct 30 23:57:28.715553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.715420    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\" (UniqueName: \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\") pod \"612aa55a-a6c7-4482-9303-ddcdda725d9e\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") "
Oct 30 23:57:28.715553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.715520    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") pod \"612aa55a-a6c7-4482-9303-ddcdda725d9e\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") "
Oct 30 23:57:28.715553 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.715547    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\") pod \"612aa55a-a6c7-4482-9303-ddcdda725d9e\" (UID: \"612aa55a-a6c7-4482-9303-ddcdda725d9e\") "
Oct 30 23:57:28.716574 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.716535    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca" pod "612aa55a-a6c7-4482-9303-ddcdda725d9e" (UID: "612aa55a-a6c7-4482-9303-ddcdda725d9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:28.718866 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.718839    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs" pod "612aa55a-a6c7-4482-9303-ddcdda725d9e" (UID: "612aa55a-a6c7-4482-9303-ddcdda725d9e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:28.723762 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.723733    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls" pod "612aa55a-a6c7-4482-9303-ddcdda725d9e" (UID: "612aa55a-a6c7-4482-9303-ddcdda725d9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:28.732473 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.732447    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j" pod "612aa55a-a6c7-4482-9303-ddcdda725d9e" (UID: "612aa55a-a6c7-4482-9303-ddcdda725d9e"). InnerVolumeSpecName "kube-api-access-sf84j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:28.817234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.817193    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/612aa55a-a6c7-4482-9303-ddcdda725d9e-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:28.817234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.817228    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf84j\" (UniqueName: \"kubernetes.io/projected/612aa55a-a6c7-4482-9303-ddcdda725d9e-kube-api-access-sf84j\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:28.817234 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.817240    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:28.817459 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:28.817250    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/612aa55a-a6c7-4482-9303-ddcdda725d9e-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:29.175978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.175940    6126 generic.go:356] "Generic (PLEG): container finished" podID="612aa55a-a6c7-4482-9303-ddcdda725d9e" containerID="35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f" exitCode=0
Oct 30 23:57:29.176186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.175992    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"
Oct 30 23:57:29.176186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.176023    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" event={"ID":"612aa55a-a6c7-4482-9303-ddcdda725d9e","Type":"ContainerDied","Data":"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"}
Oct 30 23:57:29.176186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.176083    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn" event={"ID":"612aa55a-a6c7-4482-9303-ddcdda725d9e","Type":"ContainerDied","Data":"281d3079b39cb75b65c0f61a319aa81758d052e562225cee026def95e9804091"}
Oct 30 23:57:29.176186 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.176105    6126 scope.go:122] "RemoveContainer" containerID="35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"
Oct 30 23:57:29.187461 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.187436    6126 scope.go:122] "RemoveContainer" containerID="35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"
Oct 30 23:57:29.187736 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:29.187719    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f\": container with ID starting with 35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f not found: ID does not exist" containerID="35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"
Oct 30 23:57:29.187822 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.187742    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f"} err="failed to get container status \"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f\": rpc error: code = NotFound desc = could not find container \"35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f\": container with ID starting with 35e78d217cc3de14d779e4630b0cd3f48512864fd8b3fa6145ec37b0924fc39f not found: ID does not exist"
Oct 30 23:57:29.345066 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.345032    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:57:29.352418 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:29.352389    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-333b59-7495659846-jsspn"]
Oct 30 23:57:30.406526 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:30.406489    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="612aa55a-a6c7-4482-9303-ddcdda725d9e" path="/var/lib/kubelet/pods/612aa55a-a6c7-4482-9303-ddcdda725d9e/volumes"
Oct 30 23:57:32.829076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:32.829037    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:57:34.149808 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:34.149768    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:57:35.847136 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:35.847094    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main" containerID="cri-o://d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3" gracePeriod=45
Oct 30 23:57:36.101684 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.101610    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:57:36.190263 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190228    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\" (UniqueName: \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.190518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190304    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.190518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190367    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.190518 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190418    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.190801 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190549    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:36.190894 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190873    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:36.190971 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.190890    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.193726 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.193679    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:36.206696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.206667    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "kube-api-access-cffst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:36.246734 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.246701    6126 generic.go:356] "Generic (PLEG): container finished" podID="66a72824-9a8c-4164-bb1a-67faa315e474" containerID="d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3" exitCode=0
Oct 30 23:57:36.246922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.246742    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" event={"ID":"66a72824-9a8c-4164-bb1a-67faa315e474","Type":"ContainerDied","Data":"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"}
Oct 30 23:57:36.246922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.246775    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4" event={"ID":"66a72824-9a8c-4164-bb1a-67faa315e474","Type":"ContainerDied","Data":"032a093b7a27627919225e919bfa4b530d0aaab2022a93d266eb38454aacf24f"}
Oct 30 23:57:36.246922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.246794    6126 scope.go:122] "RemoveContainer" containerID="d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"
Oct 30 23:57:36.246922 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.246914    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"
Oct 30 23:57:36.257716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.257687    6126 scope.go:122] "RemoveContainer" containerID="d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"
Oct 30 23:57:36.258059 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:36.258031    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3\": container with ID starting with d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3 not found: ID does not exist" containerID="d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"
Oct 30 23:57:36.258139 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.258072    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3"} err="failed to get container status \"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3\": rpc error: code = NotFound desc = could not find container \"d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3\": container with ID starting with d9d745445b324acf6235653026d421395b5a3006066313694091768a9839c6d3 not found: ID does not exist"
Oct 30 23:57:36.291375 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291340    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\" (UniqueName: \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.291558 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291398    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\") pod \"66a72824-9a8c-4164-bb1a-67faa315e474\" (UID: \"66a72824-9a8c-4164-bb1a-67faa315e474\") "
Oct 30 23:57:36.291704 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291677    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:36.291876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291855    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cffst\" (UniqueName: \"kubernetes.io/projected/66a72824-9a8c-4164-bb1a-67faa315e474-kube-api-access-cffst\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.291876 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291878    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.292067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291891    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.292067 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.291903    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66a72824-9a8c-4164-bb1a-67faa315e474-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.294194 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.294167    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs" pod "66a72824-9a8c-4164-bb1a-67faa315e474" (UID: "66a72824-9a8c-4164-bb1a-67faa315e474"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:36.393355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.393269    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66a72824-9a8c-4164-bb1a-67faa315e474-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:36.665676 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.665559    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:57:36.667980 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:36.667954    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-aadaa6/distinct-2-w6-aadaa6-kserve-5bc9db5f4-7t4r4"]
Oct 30 23:57:38.407155 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:38.407120    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" path="/var/lib/kubelet/pods/66a72824-9a8c-4164-bb1a-67faa315e474/volumes"
Oct 30 23:57:42.829132 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:42.829093    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:57:44.139835 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:44.139796    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:57:45.299327 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.299294    6126 generic.go:356] "Generic (PLEG): container finished" podID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerID="19398d019a3526704e4be1e9a99232df4c62ab5f7500589c9e3610870d818548" exitCode=0
Oct 30 23:57:45.299735 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.299364    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" event={"ID":"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf","Type":"ContainerDied","Data":"19398d019a3526704e4be1e9a99232df4c62ab5f7500589c9e3610870d818548"}
Oct 30 23:57:45.421065 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.421037    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:57:45.497575 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.497544    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\") pod \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") "
Oct 30 23:57:45.497786 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.497599    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\" (UniqueName: \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\") pod \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\" (UID: \"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf\") "
Oct 30 23:57:45.498025 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.497998    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume" pod "70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" (UID: "70f25999-f0d2-4cd4-8120-b5d75a2dcaaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:45.499858 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.499837    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w" pod "70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" (UID: "70f25999-f0d2-4cd4-8120-b5d75a2dcaaf"). InnerVolumeSpecName "kube-api-access-52v7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:45.599134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.599102    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:45.599134 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:45.599130    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52v7w\" (UniqueName: \"kubernetes.io/projected/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf-kube-api-access-52v7w\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:46.307084 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:46.307059    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"
Oct 30 23:57:46.307591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:46.307109    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc" event={"ID":"70f25999-f0d2-4cd4-8120-b5d75a2dcaaf","Type":"ContainerDied","Data":"0357feef378c4ff21a30fd2ac881e9d40170b94c6f702df02a09fb63c70b2a3c"}
Oct 30 23:57:46.307591 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:46.307159    6126 scope.go:122] "RemoveContainer" containerID="19398d019a3526704e4be1e9a99232df4c62ab5f7500589c9e3610870d818548"
Oct 30 23:57:46.489108 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:46.489069    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:57:46.539818 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:46.539781    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-333b59-8649d69bc-g76zc"]
Oct 30 23:57:48.405254 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:48.405223    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" path="/var/lib/kubelet/pods/70f25999-f0d2-4cd4-8120-b5d75a2dcaaf/volumes"
Oct 30 23:57:51.219337 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.219307    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:57:51.219941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.219519    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" podUID="82ccf2d4-7140-43de-844a-78e35f84a2f3" containerName="maas-api" containerID="cri-o://444215b73b2a6b61a4dd39087fc3a93835a2449eb022cf85356cafb02fb1265d" gracePeriod=30
Oct 30 23:57:51.335020 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.334988    6126 generic.go:356] "Generic (PLEG): container finished" podID="82ccf2d4-7140-43de-844a-78e35f84a2f3" containerID="444215b73b2a6b61a4dd39087fc3a93835a2449eb022cf85356cafb02fb1265d" exitCode=0
Oct 30 23:57:51.335133 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.335042    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" event={"ID":"82ccf2d4-7140-43de-844a-78e35f84a2f3","Type":"ContainerDied","Data":"444215b73b2a6b61a4dd39087fc3a93835a2449eb022cf85356cafb02fb1265d"}
Oct 30 23:57:51.463805 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.463767    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:57:51.560584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.560510    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\") pod \"82ccf2d4-7140-43de-844a-78e35f84a2f3\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") "
Oct 30 23:57:51.560584 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.560560    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\" (UniqueName: \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\") pod \"82ccf2d4-7140-43de-844a-78e35f84a2f3\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") "
Oct 30 23:57:51.560800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.560606    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\") pod \"82ccf2d4-7140-43de-844a-78e35f84a2f3\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") "
Oct 30 23:57:51.560800 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.560744    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") pod \"82ccf2d4-7140-43de-844a-78e35f84a2f3\" (UID: \"82ccf2d4-7140-43de-844a-78e35f84a2f3\") "
Oct 30 23:57:51.561056 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.561030    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca" pod "82ccf2d4-7140-43de-844a-78e35f84a2f3" (UID: "82ccf2d4-7140-43de-844a-78e35f84a2f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:51.561181 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.561163    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ccf2d4-7140-43de-844a-78e35f84a2f3-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:51.562906 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.562879    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls" pod "82ccf2d4-7140-43de-844a-78e35f84a2f3" (UID: "82ccf2d4-7140-43de-844a-78e35f84a2f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:51.562997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.562919    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs" pod "82ccf2d4-7140-43de-844a-78e35f84a2f3" (UID: "82ccf2d4-7140-43de-844a-78e35f84a2f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:51.562997 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.562953    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8" pod "82ccf2d4-7140-43de-844a-78e35f84a2f3" (UID: "82ccf2d4-7140-43de-844a-78e35f84a2f3"). InnerVolumeSpecName "kube-api-access-zxsq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:51.661941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.661910    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:51.661941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.661938    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82ccf2d4-7140-43de-844a-78e35f84a2f3-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:51.661941 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:51.661948    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxsq8\" (UniqueName: \"kubernetes.io/projected/82ccf2d4-7140-43de-844a-78e35f84a2f3-kube-api-access-zxsq8\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:52.342696 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.342662    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx" event={"ID":"82ccf2d4-7140-43de-844a-78e35f84a2f3","Type":"ContainerDied","Data":"a2b4cca88db6f6b8f2612d737bfc31d9636c672c7199bb40183f06c07dd92fcb"}
Oct 30 23:57:52.343188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.342734    6126 scope.go:122] "RemoveContainer" containerID="444215b73b2a6b61a4dd39087fc3a93835a2449eb022cf85356cafb02fb1265d"
Oct 30 23:57:52.343188 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.342678    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"
Oct 30 23:57:52.451483 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.451437    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:57:52.451738 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.451670    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" podUID="8d15304e-984a-4e64-8bd5-f53283f8f05d" containerName="maas-api" containerID="cri-o://c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e" gracePeriod=30
Oct 30 23:57:52.513091 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.513062    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:57:52.518502 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.518473    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5dc3c0-55b4b9d8dd-csbsx"]
Oct 30 23:57:52.714500 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.714454    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:57:52.772724 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.772696    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\") pod \"8d15304e-984a-4e64-8bd5-f53283f8f05d\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") "
Oct 30 23:57:52.772891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.772830    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\") pod \"8d15304e-984a-4e64-8bd5-f53283f8f05d\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") "
Oct 30 23:57:52.772891 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.772871    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\" (UniqueName: \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\") pod \"8d15304e-984a-4e64-8bd5-f53283f8f05d\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") "
Oct 30 23:57:52.772978 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.772911    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") pod \"8d15304e-984a-4e64-8bd5-f53283f8f05d\" (UID: \"8d15304e-984a-4e64-8bd5-f53283f8f05d\") "
Oct 30 23:57:52.773255 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.773222    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca" pod "8d15304e-984a-4e64-8bd5-f53283f8f05d" (UID: "8d15304e-984a-4e64-8bd5-f53283f8f05d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:52.773355 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.773294    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d15304e-984a-4e64-8bd5-f53283f8f05d-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:52.774932 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.774907    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs" pod "8d15304e-984a-4e64-8bd5-f53283f8f05d" (UID: "8d15304e-984a-4e64-8bd5-f53283f8f05d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:52.775076 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.775061    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj" pod "8d15304e-984a-4e64-8bd5-f53283f8f05d" (UID: "8d15304e-984a-4e64-8bd5-f53283f8f05d"). InnerVolumeSpecName "kube-api-access-dknqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:52.775131 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.775106    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls" pod "8d15304e-984a-4e64-8bd5-f53283f8f05d" (UID: "8d15304e-984a-4e64-8bd5-f53283f8f05d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:52.874991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.874898    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknqj\" (UniqueName: \"kubernetes.io/projected/8d15304e-984a-4e64-8bd5-f53283f8f05d-kube-api-access-dknqj\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:52.874991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.874931    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:52.874991 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:52.874941    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d15304e-984a-4e64-8bd5-f53283f8f05d-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:53.350789 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.350757    6126 generic.go:356] "Generic (PLEG): container finished" podID="8d15304e-984a-4e64-8bd5-f53283f8f05d" containerID="c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e" exitCode=0
Oct 30 23:57:53.351303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.350796    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" event={"ID":"8d15304e-984a-4e64-8bd5-f53283f8f05d","Type":"ContainerDied","Data":"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"}
Oct 30 23:57:53.351303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.350805    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"
Oct 30 23:57:53.351303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.350842    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5" event={"ID":"8d15304e-984a-4e64-8bd5-f53283f8f05d","Type":"ContainerDied","Data":"b91b3fd92fef3cb72cdb9c6221eee7b4d60e11f6ad0c498dc83e6cf3fe598a31"}
Oct 30 23:57:53.351303 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.350872    6126 scope.go:122] "RemoveContainer" containerID="c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"
Oct 30 23:57:53.361129 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.361109    6126 scope.go:122] "RemoveContainer" containerID="c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"
Oct 30 23:57:53.361397 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:57:53.361375    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e\": container with ID starting with c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e not found: ID does not exist" containerID="c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"
Oct 30 23:57:53.361468 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.361409    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e"} err="failed to get container status \"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e\": rpc error: code = NotFound desc = could not find container \"c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e\": container with ID starting with c58fe2376941e7b4055a7179f321b817f002e6accc08352f621c3d0a8e87504e not found: ID does not exist"
Oct 30 23:57:53.538513 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.538473    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:57:53.548702 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:53.548676    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-aadaa6-85f94bd449-85hc5"]
Oct 30 23:57:54.405334 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:54.405305    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82ccf2d4-7140-43de-844a-78e35f84a2f3" path="/var/lib/kubelet/pods/82ccf2d4-7140-43de-844a-78e35f84a2f3/volumes"
Oct 30 23:57:54.405788 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:54.405773    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d15304e-984a-4e64-8bd5-f53283f8f05d" path="/var/lib/kubelet/pods/8d15304e-984a-4e64-8bd5-f53283f8f05d/volumes"
Oct 30 23:57:59.160968 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.160914    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" containerID="cri-o://bb274937330a081633add62bf08fb99741553304eb24201b2c71c672a83dd33c" gracePeriod=45
Oct 30 23:57:59.220937 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.220896    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": dial tcp 10.134.0.57:8000: connect: connection refused"
Oct 30 23:57:59.386716 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.386684    6126 generic.go:356] "Generic (PLEG): container finished" podID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerID="bb274937330a081633add62bf08fb99741553304eb24201b2c71c672a83dd33c" exitCode=0
Oct 30 23:57:59.386900 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.386735    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" event={"ID":"740a827a-149d-4204-b93a-6bc0a93aa90d","Type":"ContainerDied","Data":"bb274937330a081633add62bf08fb99741553304eb24201b2c71c672a83dd33c"}
Oct 30 23:57:59.428821 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.428751    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:57:59.548436 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548406    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548465    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\" (UniqueName: \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548499    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548665 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548532    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\" (UniqueName: \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548688    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548716    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\") pod \"740a827a-149d-4204-b93a-6bc0a93aa90d\" (UID: \"740a827a-149d-4204-b93a-6bc0a93aa90d\") "
Oct 30 23:57:59.548857 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.548740    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:59.549120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.549093    6126 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-tmp-dir\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:59.549120 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.549106    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:59.549341 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.549323    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:59.552476 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.552437    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "kube-api-access-jspzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:59.553022 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.552991    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:59.553394 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.553363    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm" pod "740a827a-149d-4204-b93a-6bc0a93aa90d" (UID: "740a827a-149d-4204-b93a-6bc0a93aa90d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:59.651024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.650986    6126 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740a827a-149d-4204-b93a-6bc0a93aa90d-tls-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:59.651024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.651015    6126 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-home\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:59.651024 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.651025    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jspzf\" (UniqueName: \"kubernetes.io/projected/740a827a-149d-4204-b93a-6bc0a93aa90d-kube-api-access-jspzf\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:59.651328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.651035    6126 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-dshm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:57:59.651328 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:57:59.651045    6126 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740a827a-149d-4204-b93a-6bc0a93aa90d-model-cache\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:58:00.394963 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:00.394919    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6" event={"ID":"740a827a-149d-4204-b93a-6bc0a93aa90d","Type":"ContainerDied","Data":"9ec0a48a53c02409e006ac3ce69b9977307539426bc68145ba2a444f3b191f10"}
Oct 30 23:58:00.395441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:00.394976    6126 scope.go:122] "RemoveContainer" containerID="bb274937330a081633add62bf08fb99741553304eb24201b2c71c672a83dd33c"
Oct 30 23:58:00.395441 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:00.394932    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"
Oct 30 23:58:00.561523 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:00.561489    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:58:00.611415 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:00.611375    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b81a7a/premium-w1-b81a7a-kserve-7888989d89-ssfp6"]
Oct 30 23:58:02.406832 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:02.406799    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" path="/var/lib/kubelet/pods/740a827a-149d-4204-b93a-6bc0a93aa90d/volumes"
Oct 30 23:58:04.150753 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:58:04.150716    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:58:14.684639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:14.679330    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:58:14.684639 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:14.679692    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" podUID="e6742a7c-7d38-432a-a159-d34a2621995d" containerName="maas-api" containerID="cri-o://71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0" gracePeriod=30
Oct 30 23:58:14.942319 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:14.942257    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:58:15.017447 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.017413    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\") pod \"e6742a7c-7d38-432a-a159-d34a2621995d\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") "
Oct 30 23:58:15.017610 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.017569    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\") pod \"e6742a7c-7d38-432a-a159-d34a2621995d\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") "
Oct 30 23:58:15.017695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.017647    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") pod \"e6742a7c-7d38-432a-a159-d34a2621995d\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") "
Oct 30 23:58:15.017695 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.017678    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\" (UniqueName: \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\") pod \"e6742a7c-7d38-432a-a159-d34a2621995d\" (UID: \"e6742a7c-7d38-432a-a159-d34a2621995d\") "
Oct 30 23:58:15.017882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.017852    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca" pod "e6742a7c-7d38-432a-a159-d34a2621995d" (UID: "e6742a7c-7d38-432a-a159-d34a2621995d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:58:15.018059 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.018038    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6742a7c-7d38-432a-a159-d34a2621995d-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:58:15.020012 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.019989    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls" pod "e6742a7c-7d38-432a-a159-d34a2621995d" (UID: "e6742a7c-7d38-432a-a159-d34a2621995d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:58:15.020111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.019989    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw" pod "e6742a7c-7d38-432a-a159-d34a2621995d" (UID: "e6742a7c-7d38-432a-a159-d34a2621995d"). InnerVolumeSpecName "kube-api-access-7m6nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:58:15.020111 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.020009    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs" pod "e6742a7c-7d38-432a-a159-d34a2621995d" (UID: "e6742a7c-7d38-432a-a159-d34a2621995d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:58:15.119492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.119456    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:58:15.119492 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.119495    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6742a7c-7d38-432a-a159-d34a2621995d-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:58:15.119780 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.119511    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m6nw\" (UniqueName: \"kubernetes.io/projected/e6742a7c-7d38-432a-a159-d34a2621995d-kube-api-access-7m6nw\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:58:15.480862 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.480829    6126 generic.go:356] "Generic (PLEG): container finished" podID="e6742a7c-7d38-432a-a159-d34a2621995d" containerID="71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0" exitCode=0
Oct 30 23:58:15.481086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.480877    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"
Oct 30 23:58:15.481086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.480919    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" event={"ID":"e6742a7c-7d38-432a-a159-d34a2621995d","Type":"ContainerDied","Data":"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"}
Oct 30 23:58:15.481086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.480976    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp" event={"ID":"e6742a7c-7d38-432a-a159-d34a2621995d","Type":"ContainerDied","Data":"360d61024ce9ac43d6aa01a81a4eec646b1d07ae68b8a5d629e7280db520caf1"}
Oct 30 23:58:15.481086 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.481004    6126 scope.go:122] "RemoveContainer" containerID="71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"
Oct 30 23:58:15.491226 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.491210    6126 scope.go:122] "RemoveContainer" containerID="71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"
Oct 30 23:58:15.491556 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:58:15.491535    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0\": container with ID starting with 71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0 not found: ID does not exist" containerID="71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"
Oct 30 23:58:15.491637 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.491565    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0"} err="failed to get container status \"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0\": rpc error: code = NotFound desc = could not find container \"71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0\": container with ID starting with 71253ed9bd3ea2edd3ddf2f68dce47af09fe21606168eafe3e4e4885f3ca63c0 not found: ID does not exist"
Oct 30 23:58:15.658433 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.658398    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:58:15.673469 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:15.673439    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b81a7a-6695468996-bvblp"]
Oct 30 23:58:16.405882 ip-10-0-133-110 kubenswrapper[6126]: I1030 23:58:16.405852    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6742a7c-7d38-432a-a159-d34a2621995d" path="/var/lib/kubelet/pods/e6742a7c-7d38-432a-a159-d34a2621995d/volumes"
Oct 30 23:58:34.150959 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:58:34.150918    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:59:04.150510 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:59:04.150467    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 30 23:59:34.150101 ip-10-0-133-110 kubenswrapper[6126]: E1030 23:59:34.150067    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:00:04.150213 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:00:04.150125    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:00:09.710158 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710122    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"]
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710576    6126 cpu_manager.go:414] "containerMap: removing container" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710587    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710608    6126 cpu_manager.go:414] "containerMap: removing container" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710627    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710638    6126 cpu_manager.go:414] "containerMap: removing container" podUID="f790bb6f-2b36-4429-b521-899f9327de51" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710643    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f790bb6f-2b36-4429-b521-899f9327de51" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710649    6126 cpu_manager.go:414] "containerMap: removing container" podUID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710654    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710661    6126 cpu_manager.go:414] "containerMap: removing container" podUID="2a8465c6-e963-41fd-adbf-893fde30f6e6" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710665    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a8465c6-e963-41fd-adbf-893fde30f6e6" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710674    6126 cpu_manager.go:414] "containerMap: removing container" podUID="945fffbd-ea25-4497-9070-bd3a74573d68" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710678    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="945fffbd-ea25-4497-9070-bd3a74573d68" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710685    6126 cpu_manager.go:414] "containerMap: removing container" podUID="926b8755-3dff-427f-bd1c-6daf594a4232" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710689    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="926b8755-3dff-427f-bd1c-6daf594a4232" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710696    6126 cpu_manager.go:414] "containerMap: removing container" podUID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710701    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" containerName="payload-processing"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710708    6126 cpu_manager.go:414] "containerMap: removing container" podUID="612aa55a-a6c7-4482-9303-ddcdda725d9e" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710712    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="612aa55a-a6c7-4482-9303-ddcdda725d9e" containerName="maas-api"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710720    6126 cpu_manager.go:414] "containerMap: removing container" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710724    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main"
Oct 31 00:00:09.710718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710730    6126 cpu_manager.go:414] "containerMap: removing container" podUID="be2e6889-92fb-45fb-aebd-f952c437cfd4" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710734    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be2e6889-92fb-45fb-aebd-f952c437cfd4" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710741    6126 cpu_manager.go:414] "containerMap: removing container" podUID="82ccf2d4-7140-43de-844a-78e35f84a2f3" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710745    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82ccf2d4-7140-43de-844a-78e35f84a2f3" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710753    6126 cpu_manager.go:414] "containerMap: removing container" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710758    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710765    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c728f89a-6114-49e1-8db2-f44e93d44f1f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710769    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c728f89a-6114-49e1-8db2-f44e93d44f1f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710775    6126 cpu_manager.go:414] "containerMap: removing container" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710780    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710787    6126 cpu_manager.go:414] "containerMap: removing container" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710792    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710799    6126 cpu_manager.go:414] "containerMap: removing container" podUID="45625647-4456-4f40-b907-95ee1e9b5615" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710803    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45625647-4456-4f40-b907-95ee1e9b5615" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710810    6126 cpu_manager.go:414] "containerMap: removing container" podUID="e6742a7c-7d38-432a-a159-d34a2621995d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710814    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6742a7c-7d38-432a-a159-d34a2621995d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710820    6126 cpu_manager.go:414] "containerMap: removing container" podUID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710825    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710831    6126 cpu_manager.go:414] "containerMap: removing container" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710835    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710840    6126 cpu_manager.go:414] "containerMap: removing container" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710844    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710852    6126 cpu_manager.go:414] "containerMap: removing container" podUID="aeb3d803-cdbf-417b-a271-1436100d7544" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710857    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb3d803-cdbf-417b-a271-1436100d7544" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710864    6126 cpu_manager.go:414] "containerMap: removing container" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710868    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710877    6126 cpu_manager.go:414] "containerMap: removing container" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710882    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710887    6126 cpu_manager.go:414] "containerMap: removing container" podUID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710891    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710901    6126 cpu_manager.go:414] "containerMap: removing container" podUID="8d15304e-984a-4e64-8bd5-f53283f8f05d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710906    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d15304e-984a-4e64-8bd5-f53283f8f05d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710912    6126 cpu_manager.go:414] "containerMap: removing container" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710916    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710922    6126 cpu_manager.go:414] "containerMap: removing container" podUID="13754fbe-0637-4b95-9d95-6302fc13b446" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710926    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13754fbe-0637-4b95-9d95-6302fc13b446" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710932    6126 cpu_manager.go:414] "containerMap: removing container" podUID="9dde2edb-297e-4c3c-b4b2-64e931435460" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710936    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dde2edb-297e-4c3c-b4b2-64e931435460" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710946    6126 cpu_manager.go:414] "containerMap: removing container" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710951    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710958    6126 cpu_manager.go:414] "containerMap: removing container" podUID="a6f85f95-17f2-40c7-86e4-35267308c14a" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710962    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6f85f95-17f2-40c7-86e4-35267308c14a" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710970    6126 cpu_manager.go:414] "containerMap: removing container" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710975    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710980    6126 cpu_manager.go:414] "containerMap: removing container" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710985    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710993    6126 cpu_manager.go:414] "containerMap: removing container" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.710998    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711004    6126 cpu_manager.go:414] "containerMap: removing container" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711009    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711014    6126 cpu_manager.go:414] "containerMap: removing container" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711018    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711088    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a92a279-1b3c-4753-afa0-e56eb2bc6e64" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711100    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbfa0346-f3d2-4c7a-9227-f08bd3aa82d4" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711109    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d15304e-984a-4e64-8bd5-f53283f8f05d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711117    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711123    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="13754fbe-0637-4b95-9d95-6302fc13b446" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711131    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dde2edb-297e-4c3c-b4b2-64e931435460" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711141    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="70f25999-f0d2-4cd4-8120-b5d75a2dcaaf" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711149    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6f85f95-17f2-40c7-86e4-35267308c14a" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711160    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="5114e2aa-0c64-447a-92a3-63da159d783f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711167    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3295459-5ee8-464f-a807-99229d7abeb3" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711177    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="437c1522-65b9-4865-af16-8e681fd44b11" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711184    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711191    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711199    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="009c5ba0-a19c-41b1-bcc9-94df2626188a" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711208    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="dea6d8a3-e3d3-4599-91f0-345e35b9bd6c" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711218    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="740a827a-149d-4204-b93a-6bc0a93aa90d" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711226    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="f790bb6f-2b36-4429-b521-899f9327de51" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711234    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bcd11cc-7a60-465d-8c5a-5a27ecf43600" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711242    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a8465c6-e963-41fd-adbf-893fde30f6e6" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711252    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="945fffbd-ea25-4497-9070-bd3a74573d68" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711261    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="926b8755-3dff-427f-bd1c-6daf594a4232" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711270    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef44ff58-5f3c-4b09-9915-655beae5ee4d" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711277    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="612aa55a-a6c7-4482-9303-ddcdda725d9e" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711284    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="66a72824-9a8c-4164-bb1a-67faa315e474" containerName="main"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711291    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="be2e6889-92fb-45fb-aebd-f952c437cfd4" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711300    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="82ccf2d4-7140-43de-844a-78e35f84a2f3" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711308    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="c728f89a-6114-49e1-8db2-f44e93d44f1f" containerName="payload-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711316    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8fd6fb5-9cbc-46e1-8c79-5c99eebb423e" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711324    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d624a70-6c08-4349-ace3-a613ad7014be" containerName="payload-pre-processing"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711332    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="45625647-4456-4f40-b907-95ee1e9b5615" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711339    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6742a7c-7d38-432a-a159-d34a2621995d" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711347    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbdf5820-be89-45ae-9b8d-47b2f8bfde53" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711356    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="469a8266-5df9-4623-8d6e-a437879fd800" containerName="istio-proxy"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711364    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeb3d803-cdbf-417b-a271-1436100d7544" containerName="maas-api"
Oct 31 00:00:09.711816 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.711373    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e2365e7-d9ec-4cb7-bda2-4544eab4eff9" containerName="payload-pre-processing"
Oct 31 00:00:09.714846 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.714830    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785112 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785077    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785112 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785125    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785339 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785143    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785339 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785271    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09235097-5c80-4957-9797-688819394a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785419 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785350    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785419 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785387    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09235097-5c80-4957-9797-688819394a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785513 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785496    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785552 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785525    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.785552 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.785546    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcgv\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-kube-api-access-zzcgv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.816008 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.815974    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"]
Oct 31 00:00:09.886544 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886496    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886544 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886548    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886574    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcgv\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-kube-api-access-zzcgv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886599    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886669    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886693    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886748    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09235097-5c80-4957-9797-688819394a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886802    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.886860 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.886861    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09235097-5c80-4957-9797-688819394a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.887235 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.887033    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.887235 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.887113    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.887355 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.887229    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.887355 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.887238    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.887453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.887419    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09235097-5c80-4957-9797-688819394a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.889027 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.889004    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09235097-5c80-4957-9797-688819394a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.889376 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.889358    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09235097-5c80-4957-9797-688819394a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.944752 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.944725    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:09.944925 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:09.944906    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcgv\" (UniqueName: \"kubernetes.io/projected/09235097-5c80-4957-9797-688819394a19-kube-api-access-zzcgv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-9w978\" (UID: \"09235097-5c80-4957-9797-688819394a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:10.027890 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:10.027847    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:10.454147 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:10.454123    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"]
Oct 31 00:00:10.456458 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:00:10.456433    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09235097_5c80_4957_9797_688819394a19.slice/crio-da12231ae67c354a115ba7aafcb58c37f0d8bd5dc324374b22d2faeefd941ae1 WatchSource:0}: Error finding container da12231ae67c354a115ba7aafcb58c37f0d8bd5dc324374b22d2faeefd941ae1: Status 404 returned error can't find the container with id da12231ae67c354a115ba7aafcb58c37f0d8bd5dc324374b22d2faeefd941ae1
Oct 31 00:00:10.458747 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:10.458715    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:10.458806 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:10.458781    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:10.458846 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:10.458813    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:11.110002 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:11.109961    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" event={"ID":"09235097-5c80-4957-9797-688819394a19","Type":"ContainerStarted","Data":"cc46f4fd884eeda2ce7b60305088a389ea31237279076935616dcee6def30b42"}
Oct 31 00:00:11.110531 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:11.110022    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" event={"ID":"09235097-5c80-4957-9797-688819394a19","Type":"ContainerStarted","Data":"da12231ae67c354a115ba7aafcb58c37f0d8bd5dc324374b22d2faeefd941ae1"}
Oct 31 00:00:11.232796 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:11.232736    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podStartSLOduration=2.2327178229999998 podStartE2EDuration="2.232717823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:11.231424923 +0000 UTC m=+3182.991517495" watchObservedRunningTime="2026-10-31 00:00:11.232717823 +0000 UTC m=+3182.992810395"
Oct 31 00:00:12.029108 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:12.029071    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:12.030666 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:12.030641    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:12.030812 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:12.030714    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:13.028891 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:13.028849    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:13.029379 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:13.028910    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:14.028321 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:14.028280    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:14.028521 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:14.028345    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:15.029239 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:15.029190    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:15.029863 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:15.029277    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:16.028369 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:16.028330    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:16.028558 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:16.028406    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:17.028487 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:17.028450    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:17.028918 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:17.028510    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:18.029136 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:18.029096    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 31 00:00:18.029561 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:18.029152    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 31 00:00:20.069810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:20.069769    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:00:20.070303 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:20.069839    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:00:21.071151 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:21.071105    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:00:21.071694 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:21.071203    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:00:22.113238 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:22.112801    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:00:22.113238 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:22.112890    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:00:23.114262 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:23.114213    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:00:23.114873 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:23.114286    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:00:23.342123 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:23.342091    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:23.342487 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:23.342466    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:23.343150 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:23.343129    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978"
Oct 31 00:00:34.150787 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:00:34.150745    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:00:39.970552 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.970512    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"]
Oct 31 00:00:39.971190 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.971168    6126 cpu_manager.go:414] "containerMap: removing container" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:39.971246 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.971194    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:39.971329 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.971317    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="6aa686b8-53b9-4b48-a3eb-66f2f78d9be6" containerName="istio-proxy"
Oct 31 00:00:39.971377 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.971330    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="42e46bfc-fb7b-46aa-a997-aca9a48b26c5" containerName="istio-proxy"
Oct 31 00:00:39.975098 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:39.975082    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115361 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115321    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a52a48a-233b-488b-bd22-12cddbc35491-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115647 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115608    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jqh\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-kube-api-access-77jqh\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115778 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115665    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115778 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115689    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115778 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115721    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115990 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115805    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a52a48a-233b-488b-bd22-12cddbc35491-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115990 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115899    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.115990 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.115937    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.116170 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.116045    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.180043 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.180009    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"]
Oct 31 00:00:40.216866 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.216812    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a52a48a-233b-488b-bd22-12cddbc35491-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.216879    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jqh\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-kube-api-access-77jqh\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.216914    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.216937    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.216969    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.217031    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a52a48a-233b-488b-bd22-12cddbc35491-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217371 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.217071    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217371 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.217106    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.217371 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.217233    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.218314 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.218286    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.218470 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.218441    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.218470 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.218419    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.218753 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.218291    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a52a48a-233b-488b-bd22-12cddbc35491-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.218753 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.218484    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.219940 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.219914    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a52a48a-233b-488b-bd22-12cddbc35491-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.220466 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.220443    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a52a48a-233b-488b-bd22-12cddbc35491-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.276120 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.276052    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.276264 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.276115    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jqh\" (UniqueName: \"kubernetes.io/projected/3a52a48a-233b-488b-bd22-12cddbc35491-kube-api-access-77jqh\") pod \"maas-default-gateway-openshift-default-5df48fcc99-spb8t\" (UID: \"3a52a48a-233b-488b-bd22-12cddbc35491\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.288561 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.288538    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:40.729687 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.729659    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"]
Oct 31 00:00:40.732107 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:00:40.732081    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a52a48a_233b_488b_bd22_12cddbc35491.slice/crio-3498fb0e34ceed2dcaff227967039c8c00a7c3ab8316a9fa232a06927af5c528 WatchSource:0}: Error finding container 3498fb0e34ceed2dcaff227967039c8c00a7c3ab8316a9fa232a06927af5c528: Status 404 returned error can't find the container with id 3498fb0e34ceed2dcaff227967039c8c00a7c3ab8316a9fa232a06927af5c528
Oct 31 00:00:40.734347 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.734314    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:40.734418 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.734382    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:40.734418 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:40.734411    6126 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:41.277968 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.272548    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" event={"ID":"3a52a48a-233b-488b-bd22-12cddbc35491","Type":"ContainerStarted","Data":"ad93cee85233343d054c34eb8ced0e50f327c1ab96537921f0d0227c2ba1b242"}
Oct 31 00:00:41.277968 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.272634    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" event={"ID":"3a52a48a-233b-488b-bd22-12cddbc35491","Type":"ContainerStarted","Data":"3498fb0e34ceed2dcaff227967039c8c00a7c3ab8316a9fa232a06927af5c528"}
Oct 31 00:00:41.297667 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.290972    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:41.297667 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.295572    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:41.297667 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.295679    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:41.405848 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:41.405777    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podStartSLOduration=2.405758076 podStartE2EDuration="2.405758076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:41.403833992 +0000 UTC m=+3213.163926585" watchObservedRunningTime="2026-10-31 00:00:41.405758076 +0000 UTC m=+3213.165850645"
Oct 31 00:00:42.290645 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:42.289040    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:42.290645 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:42.289102    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:43.303644 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:43.301562    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:43.303644 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:43.301639    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:44.300642 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:44.297973    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:44.300642 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:44.298032    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:45.299644 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:45.297040    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:45.299644 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:45.297109    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:46.289639 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:46.288937    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:46.289639 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:46.289014    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:47.289727 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:47.289688    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:47.290236 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:47.289755    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:48.289452 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:48.289411    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 31 00:00:48.289675 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:48.289479    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 31 00:00:50.329795 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:50.329758    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:00:50.330327 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:50.329815    6126 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:00:51.245823 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:51.244776    6126 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:51.248470 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:51.248390    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:00:51.249282 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:00:51.249259    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t"
Oct 31 00:01:04.152104 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:01:04.152065    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:01:07.056873 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:01:07.056836    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:01:07.057686 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:01:07.057648    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:01:34.150799 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:01:34.150762    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:02:04.150491 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:02:04.150454    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:02:09.050511 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:02:09.050483    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:02:09.070586 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:02:09.070563    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:02:34.153758 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:02:34.153713    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:03:04.150087 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:03:04.150003    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:03:34.150667 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:03:34.150610    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:04:04.152923 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:04:04.152884    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:04:34.175292 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:04:34.175247    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:05:04.151540 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:05:04.151502    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:05:32.857861 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.857823    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:05:32.861841 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.861825    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:32.915782 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.915755    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-9b1704\""
Oct 31 00:05:32.956941 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.956902    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ghm\" (UniqueName: \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:32.957142 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.956962    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:32.966238 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.966212    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-bd0c2d3e-dockercfg-tqpx7\""
Oct 31 00:05:32.967974 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:32.967952    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:05:33.057815 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.057782    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ghm\" (UniqueName: \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:33.057988 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.057825    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:33.058577 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.058559    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:33.117118 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.117041    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ghm\" (UniqueName: \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\") pod \"payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:33.175237 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.175207    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:33.563820 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:33.563658    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:05:33.566358 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:05:33.566327    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd283c661_3ae2_48de_bb26_b6f15a8d246f.slice/crio-6dc3f901b3edfb13e8e80c86dc74a56f123819b2446bac6fe35479d9e9ae98b7 WatchSource:0}: Error finding container 6dc3f901b3edfb13e8e80c86dc74a56f123819b2446bac6fe35479d9e9ae98b7: Status 404 returned error can't find the container with id 6dc3f901b3edfb13e8e80c86dc74a56f123819b2446bac6fe35479d9e9ae98b7
Oct 31 00:05:34.083509 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:34.083469    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" event={"ID":"d283c661-3ae2-48de-bb26-b6f15a8d246f","Type":"ContainerStarted","Data":"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"}
Oct 31 00:05:34.084026 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:34.083549    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" event={"ID":"d283c661-3ae2-48de-bb26-b6f15a8d246f","Type":"ContainerStarted","Data":"6dc3f901b3edfb13e8e80c86dc74a56f123819b2446bac6fe35479d9e9ae98b7"}
Oct 31 00:05:34.084026 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:34.083665    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:05:34.149909 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:05:34.149874    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:05:34.202184 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:34.202130    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" podStartSLOduration=2.202115784 podStartE2EDuration="2.202115784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:05:34.199540934 +0000 UTC m=+3505.959633529" watchObservedRunningTime="2026-10-31 00:05:34.202115784 +0000 UTC m=+3505.962208355"
Oct 31 00:05:35.342863 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.342828    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:05:35.350191 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.350165    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.385125 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.385094    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.385325 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.385293    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.385395 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.385376    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.385531 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.385512    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wc95\" (UniqueName: \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.404981 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.404957    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:05:35.453657 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.453599    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-9b1704-serving-cert\""
Oct 31 00:05:35.486547 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.486512    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.486752 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.486565    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.486752 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.486661    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wc95\" (UniqueName: \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.486752 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.486721    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.486941 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:05:35.486755    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-serving-cert: secret "maas-api-e2e-worker-single-main-9b1704-serving-cert" not found
Oct 31 00:05:35.486941 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:05:35.486845    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls podName:39384e3e-14ed-48eb-9005-361a116d51f9 nodeName:}" failed. No retries permitted until 2026-10-31 00:05:35.986825106 +0000 UTC m=+3507.746917664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls") pod "maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" (UID: "39384e3e-14ed-48eb-9005-361a116d51f9") : secret "maas-api-e2e-worker-single-main-9b1704-serving-cert" not found
Oct 31 00:05:35.487288 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.487261    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.489346 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.489319    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.568196 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.568160    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wc95\" (UniqueName: \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.993043 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.993002    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:35.995725 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:35.995695    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:36.263844 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:36.263761    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:36.641386 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:36.641334    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:05:36.643813 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:05:36.643771    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39384e3e_14ed_48eb_9005_361a116d51f9.slice/crio-0d1568fa22e6fba59df3e81655dfddacf9651278683a4bafafb99af7f38d8642 WatchSource:0}: Error finding container 0d1568fa22e6fba59df3e81655dfddacf9651278683a4bafafb99af7f38d8642: Status 404 returned error can't find the container with id 0d1568fa22e6fba59df3e81655dfddacf9651278683a4bafafb99af7f38d8642
Oct 31 00:05:36.645293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:36.645276    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:05:37.099688 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:37.099648    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" event={"ID":"39384e3e-14ed-48eb-9005-361a116d51f9","Type":"ContainerStarted","Data":"0d1568fa22e6fba59df3e81655dfddacf9651278683a4bafafb99af7f38d8642"}
Oct 31 00:05:38.106699 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:38.106654    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" event={"ID":"39384e3e-14ed-48eb-9005-361a116d51f9","Type":"ContainerStarted","Data":"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"}
Oct 31 00:05:38.107192 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:38.106734    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:38.231575 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:38.231518    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" podStartSLOduration=2.254060196 podStartE2EDuration="3.231503346s" totalImagesPullingTime="977.44315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:05:38.229363 +0000 UTC m=+3509.989455572" watchObservedRunningTime="2026-10-31 00:05:38.231503346 +0000 UTC m=+3509.991595918"
Oct 31 00:05:44.117917 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:44.117888    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:05:45.092032 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:05:45.092000    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:06:04.149909 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:06:04.149872    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:06:34.150134 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:06:34.150097    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:07:04.151036 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:07:04.150997    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:07:05.607961 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:05.607928    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:07:09.086129 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:09.086099    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:07:09.107611 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:09.107589    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:07:10.609059 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:10.609016    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing" containerID="cri-o://c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9" gracePeriod=25
Oct 31 00:07:12.690370 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:12.690337    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:07:12.690832 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:12.690549    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" podUID="39384e3e-14ed-48eb-9005-361a116d51f9" containerName="maas-api" containerID="cri-o://a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3" gracePeriod=30
Oct 31 00:07:13.959414 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:13.959388    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:07:14.051020 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.050920    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\" (UniqueName: \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\") pod \"39384e3e-14ed-48eb-9005-361a116d51f9\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") "
Oct 31 00:07:14.051020 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.050972    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") pod \"39384e3e-14ed-48eb-9005-361a116d51f9\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") "
Oct 31 00:07:14.051286 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.051048    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\") pod \"39384e3e-14ed-48eb-9005-361a116d51f9\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") "
Oct 31 00:07:14.051286 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.051222    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\") pod \"39384e3e-14ed-48eb-9005-361a116d51f9\" (UID: \"39384e3e-14ed-48eb-9005-361a116d51f9\") "
Oct 31 00:07:14.051598 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.051574    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca" pod "39384e3e-14ed-48eb-9005-361a116d51f9" (UID: "39384e3e-14ed-48eb-9005-361a116d51f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:07:14.052163 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.052137    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39384e3e-14ed-48eb-9005-361a116d51f9-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:14.053233 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.053193    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95" pod "39384e3e-14ed-48eb-9005-361a116d51f9" (UID: "39384e3e-14ed-48eb-9005-361a116d51f9"). InnerVolumeSpecName "kube-api-access-2wc95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:07:14.053364 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.053304    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls" pod "39384e3e-14ed-48eb-9005-361a116d51f9" (UID: "39384e3e-14ed-48eb-9005-361a116d51f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:07:14.053364 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.053325    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs" pod "39384e3e-14ed-48eb-9005-361a116d51f9" (UID: "39384e3e-14ed-48eb-9005-361a116d51f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:07:14.153672 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.153608    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wc95\" (UniqueName: \"kubernetes.io/projected/39384e3e-14ed-48eb-9005-361a116d51f9-kube-api-access-2wc95\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:14.153672 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.153668    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:14.153672 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.153678    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39384e3e-14ed-48eb-9005-361a116d51f9-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:14.614141 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.614096    6126 generic.go:356] "Generic (PLEG): container finished" podID="39384e3e-14ed-48eb-9005-361a116d51f9" containerID="a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3" exitCode=0
Oct 31 00:07:14.614384 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.614177    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"
Oct 31 00:07:14.614384 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.614264    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" event={"ID":"39384e3e-14ed-48eb-9005-361a116d51f9","Type":"ContainerDied","Data":"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"}
Oct 31 00:07:14.614384 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.614349    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv" event={"ID":"39384e3e-14ed-48eb-9005-361a116d51f9","Type":"ContainerDied","Data":"0d1568fa22e6fba59df3e81655dfddacf9651278683a4bafafb99af7f38d8642"}
Oct 31 00:07:14.614384 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.614381    6126 scope.go:122] "RemoveContainer" containerID="a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"
Oct 31 00:07:14.624003 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.623983    6126 scope.go:122] "RemoveContainer" containerID="a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"
Oct 31 00:07:14.624296 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:07:14.624274    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3\": container with ID starting with a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3 not found: ID does not exist" containerID="a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"
Oct 31 00:07:14.624359 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.624305    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3"} err="failed to get container status \"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3\": rpc error: code = NotFound desc = could not find container \"a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3\": container with ID starting with a1d8f8a1a6889582106095e44c927f0cf58a09908a7d9c7161eacbd9431e5ef3 not found: ID does not exist"
Oct 31 00:07:14.780246 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.780208    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:07:14.830611 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:14.830579    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9b1704-57bd4cbf49-7jppv"]
Oct 31 00:07:15.090894 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:15.090809    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:07:16.406091 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:16.406056    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39384e3e-14ed-48eb-9005-361a116d51f9" path="/var/lib/kubelet/pods/39384e3e-14ed-48eb-9005-361a116d51f9/volumes"
Oct 31 00:07:25.090565 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:25.090526    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:07:30.876558 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.876491    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:07:30.936537 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.936500    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\") pod \"d283c661-3ae2-48de-bb26-b6f15a8d246f\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") "
Oct 31 00:07:30.936738 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.936667    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\" (UniqueName: \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\") pod \"d283c661-3ae2-48de-bb26-b6f15a8d246f\" (UID: \"d283c661-3ae2-48de-bb26-b6f15a8d246f\") "
Oct 31 00:07:30.936911 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.936890    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume" pod "d283c661-3ae2-48de-bb26-b6f15a8d246f" (UID: "d283c661-3ae2-48de-bb26-b6f15a8d246f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:07:30.937021 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.937005    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d283c661-3ae2-48de-bb26-b6f15a8d246f-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:30.938874 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:30.938854    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm" pod "d283c661-3ae2-48de-bb26-b6f15a8d246f" (UID: "d283c661-3ae2-48de-bb26-b6f15a8d246f"). InnerVolumeSpecName "kube-api-access-l5ghm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:07:31.038391 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.038351    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5ghm\" (UniqueName: \"kubernetes.io/projected/d283c661-3ae2-48de-bb26-b6f15a8d246f-kube-api-access-l5ghm\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:31.722830 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.722786    6126 generic.go:356] "Generic (PLEG): container finished" podID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerID="c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9" exitCode=0
Oct 31 00:07:31.723045 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.722846    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"
Oct 31 00:07:31.723045 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.722870    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" event={"ID":"d283c661-3ae2-48de-bb26-b6f15a8d246f","Type":"ContainerDied","Data":"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"}
Oct 31 00:07:31.723045 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.722948    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc" event={"ID":"d283c661-3ae2-48de-bb26-b6f15a8d246f","Type":"ContainerDied","Data":"6dc3f901b3edfb13e8e80c86dc74a56f123819b2446bac6fe35479d9e9ae98b7"}
Oct 31 00:07:31.723045 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.722970    6126 scope.go:122] "RemoveContainer" containerID="c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"
Oct 31 00:07:31.732712 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.732570    6126 scope.go:122] "RemoveContainer" containerID="c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"
Oct 31 00:07:31.732852 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:07:31.732835    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9\": container with ID starting with c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9 not found: ID does not exist" containerID="c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"
Oct 31 00:07:31.732895 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.732860    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9"} err="failed to get container status \"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9\": rpc error: code = NotFound desc = could not find container \"c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9\": container with ID starting with c5d5c72fec8ebafaa1b65f0f373a8a16bd839d52c19ab60e09537e5cd33aa0f9 not found: ID does not exist"
Oct 31 00:07:31.887493 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.887461    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:07:31.938072 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:31.938037    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-9b1704-cd466x5hkc"]
Oct 31 00:07:32.406131 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:32.406097    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" path="/var/lib/kubelet/pods/d283c661-3ae2-48de-bb26-b6f15a8d246f/volumes"
Oct 31 00:07:34.150763 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:07:34.150723    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:07:41.844634 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:41.844591    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 31 00:07:41.845165 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:41.844887    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" podUID="47ad46d6-92af-48ab-acdf-197895d555ec" containerName="manager" containerID="cri-o://a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95" gracePeriod=10
Oct 31 00:07:42.108359 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.108289    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 31 00:07:42.161028 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.160995    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\") pod \"47ad46d6-92af-48ab-acdf-197895d555ec\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") "
Oct 31 00:07:42.161211 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.161056    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\" (UniqueName: \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\") pod \"47ad46d6-92af-48ab-acdf-197895d555ec\" (UID: \"47ad46d6-92af-48ab-acdf-197895d555ec\") "
Oct 31 00:07:42.161463 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.161434    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume" pod "47ad46d6-92af-48ab-acdf-197895d555ec" (UID: "47ad46d6-92af-48ab-acdf-197895d555ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:07:42.163343 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.163313    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz" pod "47ad46d6-92af-48ab-acdf-197895d555ec" (UID: "47ad46d6-92af-48ab-acdf-197895d555ec"). InnerVolumeSpecName "kube-api-access-q9wqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:07:42.262297 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.262257    6126 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ad46d6-92af-48ab-acdf-197895d555ec-extensions-socket-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:42.262297 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.262290    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9wqz\" (UniqueName: \"kubernetes.io/projected/47ad46d6-92af-48ab-acdf-197895d555ec-kube-api-access-q9wqz\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:07:42.783634 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.783580    6126 generic.go:356] "Generic (PLEG): container finished" podID="47ad46d6-92af-48ab-acdf-197895d555ec" containerID="a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95" exitCode=0
Oct 31 00:07:42.783815 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.783655    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"
Oct 31 00:07:42.783815 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.783674    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" event={"ID":"47ad46d6-92af-48ab-acdf-197895d555ec","Type":"ContainerDied","Data":"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"}
Oct 31 00:07:42.783815 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.783729    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx" event={"ID":"47ad46d6-92af-48ab-acdf-197895d555ec","Type":"ContainerDied","Data":"57fbf63c41556f07ed73af47a963f0345c38e6c4fcde8cb2afb856f759e816ae"}
Oct 31 00:07:42.783815 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.783750    6126 scope.go:122] "RemoveContainer" containerID="a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"
Oct 31 00:07:42.796099 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.796082    6126 scope.go:122] "RemoveContainer" containerID="a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"
Oct 31 00:07:42.796356 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:07:42.796330    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95\": container with ID starting with a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95 not found: ID does not exist" containerID="a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"
Oct 31 00:07:42.796402 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.796355    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95"} err="failed to get container status \"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95\": rpc error: code = NotFound desc = could not find container \"a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95\": container with ID starting with a755e8a277b3037dabecfd5c6d49983b8482f3efde8bf38b13de4097e2208e95 not found: ID does not exist"
Oct 31 00:07:42.949453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:42.949420    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 31 00:07:43.000071 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:43.000038    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-slwlx"]
Oct 31 00:07:44.410207 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:07:44.410171    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47ad46d6-92af-48ab-acdf-197895d555ec" path="/var/lib/kubelet/pods/47ad46d6-92af-48ab-acdf-197895d555ec/volumes"
Oct 31 00:08:04.150595 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:08:04.150557    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:08:34.151175 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:08:34.151131    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:08:45.465527 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.465440    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"]
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.465955    6126 cpu_manager.go:414] "containerMap: removing container" podUID="47ad46d6-92af-48ab-acdf-197895d555ec" containerName="manager"
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.465968    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47ad46d6-92af-48ab-acdf-197895d555ec" containerName="manager"
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.465984    6126 cpu_manager.go:414] "containerMap: removing container" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing"
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.465993    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing"
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.466020    6126 cpu_manager.go:414] "containerMap: removing container" podUID="39384e3e-14ed-48eb-9005-361a116d51f9" containerName="maas-api"
Oct 31 00:08:45.466024 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.466026    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39384e3e-14ed-48eb-9005-361a116d51f9" containerName="maas-api"
Oct 31 00:08:45.466249 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.466111    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="d283c661-3ae2-48de-bb26-b6f15a8d246f" containerName="payload-pre-processing"
Oct 31 00:08:45.466249 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.466125    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="39384e3e-14ed-48eb-9005-361a116d51f9" containerName="maas-api"
Oct 31 00:08:45.466249 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.466136    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="47ad46d6-92af-48ab-acdf-197895d555ec" containerName="manager"
Oct 31 00:08:45.469141 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.469118    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.524961 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.524932    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj2gv\" (UniqueName: \"kubernetes.io/projected/79396f50-5c0f-4a74-a4a3-91934f588725-kube-api-access-jj2gv\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.525137 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.524971    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79396f50-5c0f-4a74-a4a3-91934f588725-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.534093 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.534064    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 00:08:45.575323 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.575294    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 00:08:45.575479 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.575356    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rsddc\""
Oct 31 00:08:45.577254 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.577223    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"]
Oct 31 00:08:45.626586 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.626559    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj2gv\" (UniqueName: \"kubernetes.io/projected/79396f50-5c0f-4a74-a4a3-91934f588725-kube-api-access-jj2gv\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.626742 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.626593    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79396f50-5c0f-4a74-a4a3-91934f588725-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.626964 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.626948    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79396f50-5c0f-4a74-a4a3-91934f588725-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.686250 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.686226    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj2gv\" (UniqueName: \"kubernetes.io/projected/79396f50-5c0f-4a74-a4a3-91934f588725-kube-api-access-jj2gv\") pod \"kuadrant-operator-controller-manager-678d87766f-jzsf4\" (UID: \"79396f50-5c0f-4a74-a4a3-91934f588725\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:45.783088 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:45.783054    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:46.264571 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:46.264540    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"]
Oct 31 00:08:46.305763 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:08:46.305722    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79396f50_5c0f_4a74_a4a3_91934f588725.slice/crio-77bae02b5bf36b63672ff589b1bacbd8df71cf5b38afdc829656c3052b19a721 WatchSource:0}: Error finding container 77bae02b5bf36b63672ff589b1bacbd8df71cf5b38afdc829656c3052b19a721: Status 404 returned error can't find the container with id 77bae02b5bf36b63672ff589b1bacbd8df71cf5b38afdc829656c3052b19a721
Oct 31 00:08:47.116647 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:47.116577    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4" event={"ID":"79396f50-5c0f-4a74-a4a3-91934f588725","Type":"ContainerStarted","Data":"f7593b3ad994d64922436fd7aa1060474245b09051ef14be133216e4d50eb9ed"}
Oct 31 00:08:47.117039 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:47.116689    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4" event={"ID":"79396f50-5c0f-4a74-a4a3-91934f588725","Type":"ContainerStarted","Data":"77bae02b5bf36b63672ff589b1bacbd8df71cf5b38afdc829656c3052b19a721"}
Oct 31 00:08:47.117039 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:47.116719    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:08:47.235800 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:47.235754    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4" podStartSLOduration=2.235741845 podStartE2EDuration="2.235741845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:08:47.235282765 +0000 UTC m=+3698.995375339" watchObservedRunningTime="2026-10-31 00:08:47.235741845 +0000 UTC m=+3698.995834415"
Oct 31 00:08:58.124570 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:08:58.124534    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jzsf4"
Oct 31 00:09:04.150525 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:09:04.150489    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:09:34.150576 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:09:34.150530    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:10:03.390889 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.390857    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:10:03.395096 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.395070    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.451127 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.451095    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:10:03.499127 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.499097    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-f5f39e\""
Oct 31 00:10:03.499356 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.499262    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-6f907605-dockercfg-8cxcn\""
Oct 31 00:10:03.559920 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.559881    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rg96\" (UniqueName: \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.559920 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.559918    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.661095 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.661000    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rg96\" (UniqueName: \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.661095 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.661038    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.661769 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.661750    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:03.719031 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:03.718992    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rg96\" (UniqueName: \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\") pod \"payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:04.008897 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.008864    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:04.150507 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:10:04.150468    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:10:04.385674 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.385651    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:10:04.388286 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:10:04.388252    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddadd98_e6a8_40ca_9be5_e24c04c9a288.slice/crio-1ee2ff724ff76fdf5cc2ec1f4442a94af96b6c072dcfc36a39df051495a53f84 WatchSource:0}: Error finding container 1ee2ff724ff76fdf5cc2ec1f4442a94af96b6c072dcfc36a39df051495a53f84: Status 404 returned error can't find the container with id 1ee2ff724ff76fdf5cc2ec1f4442a94af96b6c072dcfc36a39df051495a53f84
Oct 31 00:10:04.569107 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.569065    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" event={"ID":"addadd98-e6a8-40ca-9be5-e24c04c9a288","Type":"ContainerStarted","Data":"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"}
Oct 31 00:10:04.569495 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.569129    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" event={"ID":"addadd98-e6a8-40ca-9be5-e24c04c9a288","Type":"ContainerStarted","Data":"1ee2ff724ff76fdf5cc2ec1f4442a94af96b6c072dcfc36a39df051495a53f84"}
Oct 31 00:10:04.569495 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.569160    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:04.688640 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:04.688519    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" podStartSLOduration=1.688505831 podStartE2EDuration="1.688505831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:10:04.687902945 +0000 UTC m=+3776.447995530" watchObservedRunningTime="2026-10-31 00:10:04.688505831 +0000 UTC m=+3776.448598402"
Oct 31 00:10:05.523080 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.523038    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:10:05.527083 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.527064    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.582175 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.582144    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-f5f39e-serving-cert\""
Oct 31 00:10:05.634465 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.634429    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:10:05.681755 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.681715    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.681934 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.681771    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw46d\" (UniqueName: \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.681991 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.681932    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.681991 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.681971    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.783009 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.782908    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.783009 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.782956    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw46d\" (UniqueName: \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.783009 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.782987    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.783009 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.783003    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.783697 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.783664    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.785775 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.785746    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.785890 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.785813    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:05.840914 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:05.840880    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw46d\" (UniqueName: \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\") pod \"maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:06.140126 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:06.140033    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:06.516673 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:06.516646    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:10:06.518873 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:10:06.518845    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f443d1_8e12_440c_92db_c2855867f651.slice/crio-db2ebbbfb6edf2fac5f9df0ea034edf21ad81d684aa918070c5f9e74f8dfedfd WatchSource:0}: Error finding container db2ebbbfb6edf2fac5f9df0ea034edf21ad81d684aa918070c5f9e74f8dfedfd: Status 404 returned error can't find the container with id db2ebbbfb6edf2fac5f9df0ea034edf21ad81d684aa918070c5f9e74f8dfedfd
Oct 31 00:10:06.580845 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:06.580807    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" event={"ID":"f2f443d1-8e12-440c-92db-c2855867f651","Type":"ContainerStarted","Data":"db2ebbbfb6edf2fac5f9df0ea034edf21ad81d684aa918070c5f9e74f8dfedfd"}
Oct 31 00:10:07.591448 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:07.591315    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" event={"ID":"f2f443d1-8e12-440c-92db-c2855867f651","Type":"ContainerStarted","Data":"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"}
Oct 31 00:10:07.591448 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:07.591437    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:07.707597 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:07.707542    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" podStartSLOduration=1.894061197 podStartE2EDuration="2.707528211s" totalImagesPullingTime="813.467014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:10:07.706200367 +0000 UTC m=+3779.466292939" watchObservedRunningTime="2026-10-31 00:10:07.707528211 +0000 UTC m=+3779.467620782"
Oct 31 00:10:13.603160 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:13.603129    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:10:15.577894 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:10:15.577796    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:10:34.150371 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:10:34.150326    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:11:04.150707 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:11:04.150667    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:11:34.150677 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:11:34.150632    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:11:35.902327 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:35.902297    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:11:40.903230 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:40.903185    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing" containerID="cri-o://fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1" gracePeriod=25
Oct 31 00:11:42.530357 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:42.530323    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:11:42.530839 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:42.530523    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" podUID="f2f443d1-8e12-440c-92db-c2855867f651" containerName="maas-api" containerID="cri-o://153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55" gracePeriod=30
Oct 31 00:11:43.598112 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.598066    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" podUID="f2f443d1-8e12-440c-92db-c2855867f651" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.160:8443/health\": dial tcp 10.134.0.160:8443: connect: connection refused"
Oct 31 00:11:43.780266 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.780239    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:11:43.877534 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.877446    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\") pod \"f2f443d1-8e12-440c-92db-c2855867f651\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") "
Oct 31 00:11:43.877534 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.877521    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\" (UniqueName: \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\") pod \"f2f443d1-8e12-440c-92db-c2855867f651\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") "
Oct 31 00:11:43.877832 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.877583    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\") pod \"f2f443d1-8e12-440c-92db-c2855867f651\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") "
Oct 31 00:11:43.877832 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.877702    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\") pod \"f2f443d1-8e12-440c-92db-c2855867f651\" (UID: \"f2f443d1-8e12-440c-92db-c2855867f651\") "
Oct 31 00:11:43.878010 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.877986    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca" pod "f2f443d1-8e12-440c-92db-c2855867f651" (UID: "f2f443d1-8e12-440c-92db-c2855867f651"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:11:43.878128 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.878111    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2f443d1-8e12-440c-92db-c2855867f651-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:11:43.879891 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.879860    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d" pod "f2f443d1-8e12-440c-92db-c2855867f651" (UID: "f2f443d1-8e12-440c-92db-c2855867f651"). InnerVolumeSpecName "kube-api-access-gw46d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:11:43.880005 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.879886    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs" pod "f2f443d1-8e12-440c-92db-c2855867f651" (UID: "f2f443d1-8e12-440c-92db-c2855867f651"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:11:43.880005 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.879922    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls" pod "f2f443d1-8e12-440c-92db-c2855867f651" (UID: "f2f443d1-8e12-440c-92db-c2855867f651"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:11:43.978869 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.978837    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:11:43.978869 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.978865    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2f443d1-8e12-440c-92db-c2855867f651-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:11:43.978869 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:43.978875    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw46d\" (UniqueName: \"kubernetes.io/projected/f2f443d1-8e12-440c-92db-c2855867f651-kube-api-access-gw46d\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:11:44.127278 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.127246    6126 generic.go:356] "Generic (PLEG): container finished" podID="f2f443d1-8e12-440c-92db-c2855867f651" containerID="153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55" exitCode=0
Oct 31 00:11:44.127453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.127295    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"
Oct 31 00:11:44.127453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.127329    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" event={"ID":"f2f443d1-8e12-440c-92db-c2855867f651","Type":"ContainerDied","Data":"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"}
Oct 31 00:11:44.127453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.127388    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr" event={"ID":"f2f443d1-8e12-440c-92db-c2855867f651","Type":"ContainerDied","Data":"db2ebbbfb6edf2fac5f9df0ea034edf21ad81d684aa918070c5f9e74f8dfedfd"}
Oct 31 00:11:44.127453 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.127417    6126 scope.go:122] "RemoveContainer" containerID="153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"
Oct 31 00:11:44.138782 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.138762    6126 scope.go:122] "RemoveContainer" containerID="153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"
Oct 31 00:11:44.139037 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:11:44.139021    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55\": container with ID starting with 153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55 not found: ID does not exist" containerID="153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"
Oct 31 00:11:44.139092 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.139044    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55"} err="failed to get container status \"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55\": rpc error: code = NotFound desc = could not find container \"153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55\": container with ID starting with 153df604cd813300c3779154e863facecd10d4b0ca2975fc20f34eeef0677f55 not found: ID does not exist"
Oct 31 00:11:44.294678 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.294642    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:11:44.344717 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.344682    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-f5f39e-8dfc9db58-vn4pr"]
Oct 31 00:11:44.405999 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:44.405924    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2f443d1-8e12-440c-92db-c2855867f651" path="/var/lib/kubelet/pods/f2f443d1-8e12-440c-92db-c2855867f651/volumes"
Oct 31 00:11:45.576545 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:45.576465    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:11:55.575805 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:11:55.575768    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:12:01.165025 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.164964    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:12:01.221857 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.221824    6126 generic.go:356] "Generic (PLEG): container finished" podID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerID="fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1" exitCode=0
Oct 31 00:12:01.222052 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.221878    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"
Oct 31 00:12:01.222052 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.221905    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" event={"ID":"addadd98-e6a8-40ca-9be5-e24c04c9a288","Type":"ContainerDied","Data":"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"}
Oct 31 00:12:01.222052 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.221968    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb" event={"ID":"addadd98-e6a8-40ca-9be5-e24c04c9a288","Type":"ContainerDied","Data":"1ee2ff724ff76fdf5cc2ec1f4442a94af96b6c072dcfc36a39df051495a53f84"}
Oct 31 00:12:01.222052 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.222000    6126 scope.go:122] "RemoveContainer" containerID="fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"
Oct 31 00:12:01.231083 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.231069    6126 scope.go:122] "RemoveContainer" containerID="fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"
Oct 31 00:12:01.231311 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:12:01.231291    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1\": container with ID starting with fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1 not found: ID does not exist" containerID="fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"
Oct 31 00:12:01.231379 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.231326    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1"} err="failed to get container status \"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1\": rpc error: code = NotFound desc = could not find container \"fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1\": container with ID starting with fb9a5fb38c3706b8c9c87d991b2b9783eb011476cfe1720b3b0c43cbce4746b1 not found: ID does not exist"
Oct 31 00:12:01.262769 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.262738    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\") pod \"addadd98-e6a8-40ca-9be5-e24c04c9a288\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") "
Oct 31 00:12:01.262902 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.262845    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\" (UniqueName: \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\") pod \"addadd98-e6a8-40ca-9be5-e24c04c9a288\" (UID: \"addadd98-e6a8-40ca-9be5-e24c04c9a288\") "
Oct 31 00:12:01.263098 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.263075    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume" pod "addadd98-e6a8-40ca-9be5-e24c04c9a288" (UID: "addadd98-e6a8-40ca-9be5-e24c04c9a288"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:12:01.263275 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.263261    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/addadd98-e6a8-40ca-9be5-e24c04c9a288-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:12:01.264989 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.264967    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96" pod "addadd98-e6a8-40ca-9be5-e24c04c9a288" (UID: "addadd98-e6a8-40ca-9be5-e24c04c9a288"). InnerVolumeSpecName "kube-api-access-9rg96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:12:01.364950 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.364918    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rg96\" (UniqueName: \"kubernetes.io/projected/addadd98-e6a8-40ca-9be5-e24c04c9a288-kube-api-access-9rg96\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:12:01.642859 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.642820    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:12:01.645947 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:01.645918    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-f5f39e-7759cbf8b9snzb"]
Oct 31 00:12:02.405471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:02.405440    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" path="/var/lib/kubelet/pods/addadd98-e6a8-40ca-9be5-e24c04c9a288/volumes"
Oct 31 00:12:04.155445 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:12:04.155405    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:12:07.056643 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:07.055743    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-75r4c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:12:07.056643 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:07.055834    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-75r4c" podUID="025d9e91-ef8a-47fa-a680-3ef99f6931c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:12:07.290778 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:07.290736    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-spb8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:12:07.291079 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:07.291047    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-spb8t" podUID="3a52a48a-233b-488b-bd22-12cddbc35491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:12:09.127132 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:09.127106    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:12:09.147912 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:12:09.147887    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:12:34.151020 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:12:34.150984    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:13:04.150189 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:13:04.150151    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:13:34.151396 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:13:34.151354    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:14:04.151236 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:14:04.151202    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:14:19.829975 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.829934    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"]
Oct 31 00:14:19.830458 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830444    6126 cpu_manager.go:414] "containerMap: removing container" podUID="f2f443d1-8e12-440c-92db-c2855867f651" containerName="maas-api"
Oct 31 00:14:19.830509 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830458    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2f443d1-8e12-440c-92db-c2855867f651" containerName="maas-api"
Oct 31 00:14:19.830509 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830488    6126 cpu_manager.go:414] "containerMap: removing container" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing"
Oct 31 00:14:19.830509 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830494    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing"
Oct 31 00:14:19.830604 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830590    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="addadd98-e6a8-40ca-9be5-e24c04c9a288" containerName="payload-processing"
Oct 31 00:14:19.830677 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.830604    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2f443d1-8e12-440c-92db-c2855867f651" containerName="maas-api"
Oct 31 00:14:19.833920 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.833901    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:19.938754 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.938721    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"]
Oct 31 00:14:19.994465 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.994333    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqtg9\" (UniqueName: \"kubernetes.io/projected/7e71d396-6246-4c56-bb53-0e2a8f407c38-kube-api-access-gqtg9\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:19.994465 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.994395    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e71d396-6246-4c56-bb53-0e2a8f407c38-openshift-service-ca\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:19.994850 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.994514    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-maas-api-tls\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:19.994850 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:19.994555    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-metrics-certs\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.095522 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.095443    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-maas-api-tls\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.095522 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.095476    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-metrics-certs\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.095747 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.095603    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqtg9\" (UniqueName: \"kubernetes.io/projected/7e71d396-6246-4c56-bb53-0e2a8f407c38-kube-api-access-gqtg9\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.095747 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.095665    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e71d396-6246-4c56-bb53-0e2a8f407c38-openshift-service-ca\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.096377 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.096355    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e71d396-6246-4c56-bb53-0e2a8f407c38-openshift-service-ca\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.098342 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.098308    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-metrics-certs\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.098342 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.098315    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e71d396-6246-4c56-bb53-0e2a8f407c38-maas-api-tls\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.153145 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.153113    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqtg9\" (UniqueName: \"kubernetes.io/projected/7e71d396-6246-4c56-bb53-0e2a8f407c38-kube-api-access-gqtg9\") pod \"maas-api-85b64959d7-hnbh2\" (UID: \"7e71d396-6246-4c56-bb53-0e2a8f407c38\") " pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.447164 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.447078    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:20.822166 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.822136    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"]
Oct 31 00:14:20.825107 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:14:20.825073    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e71d396_6246_4c56_bb53_0e2a8f407c38.slice/crio-2a200c93128fb9ba8f3434295b3c43f604f6c07efe5ac8d1f422390d3f26556c WatchSource:0}: Error finding container 2a200c93128fb9ba8f3434295b3c43f604f6c07efe5ac8d1f422390d3f26556c: Status 404 returned error can't find the container with id 2a200c93128fb9ba8f3434295b3c43f604f6c07efe5ac8d1f422390d3f26556c
Oct 31 00:14:20.826508 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:20.826489    6126 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:14:21.107598 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:21.107514    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2" event={"ID":"7e71d396-6246-4c56-bb53-0e2a8f407c38","Type":"ContainerStarted","Data":"2a200c93128fb9ba8f3434295b3c43f604f6c07efe5ac8d1f422390d3f26556c"}
Oct 31 00:14:22.114476 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:22.114433    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2" event={"ID":"7e71d396-6246-4c56-bb53-0e2a8f407c38","Type":"ContainerStarted","Data":"6d5575a95b60dabd9428239955f36c062e3983d407ab03cb2ff33ff1b441a6fd"}
Oct 31 00:14:22.114930 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:22.114558    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:22.230275 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:22.230215    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2" podStartSLOduration=2.382019096 podStartE2EDuration="3.23019762s" totalImagesPullingTime="848.178524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:22.229311053 +0000 UTC m=+4033.989403626" watchObservedRunningTime="2026-10-31 00:14:22.23019762 +0000 UTC m=+4033.990290193"
Oct 31 00:14:28.125267 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:28.125237    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85b64959d7-hnbh2"
Oct 31 00:14:28.295052 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:28.295016    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 31 00:14:28.295309 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:28.295279    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" podUID="0ca1e799-3b61-4931-bebb-17513a8edd0e" containerName="maas-api" containerID="cri-o://f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a" gracePeriod=30
Oct 31 00:14:29.554580 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.554555    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 31 00:14:29.600209 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.600172    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\") pod \"0ca1e799-3b61-4931-bebb-17513a8edd0e\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") "
Oct 31 00:14:29.600406 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.600218    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\") pod \"0ca1e799-3b61-4931-bebb-17513a8edd0e\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") "
Oct 31 00:14:29.600406 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.600285    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\" (UniqueName: \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\") pod \"0ca1e799-3b61-4931-bebb-17513a8edd0e\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") "
Oct 31 00:14:29.600533 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.600465    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\") pod \"0ca1e799-3b61-4931-bebb-17513a8edd0e\" (UID: \"0ca1e799-3b61-4931-bebb-17513a8edd0e\") "
Oct 31 00:14:29.600910 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.600832    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca" pod "0ca1e799-3b61-4931-bebb-17513a8edd0e" (UID: "0ca1e799-3b61-4931-bebb-17513a8edd0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:14:29.602496 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.602463    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs" pod "0ca1e799-3b61-4931-bebb-17513a8edd0e" (UID: "0ca1e799-3b61-4931-bebb-17513a8edd0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:14:29.602496 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.602473    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82" pod "0ca1e799-3b61-4931-bebb-17513a8edd0e" (UID: "0ca1e799-3b61-4931-bebb-17513a8edd0e"). InnerVolumeSpecName "kube-api-access-zdl82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:14:29.602664 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.602503    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls" pod "0ca1e799-3b61-4931-bebb-17513a8edd0e" (UID: "0ca1e799-3b61-4931-bebb-17513a8edd0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:14:29.702635 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.702580    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ca1e799-3b61-4931-bebb-17513a8edd0e-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:14:29.702810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.702643    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:14:29.702810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.702660    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ca1e799-3b61-4931-bebb-17513a8edd0e-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:14:29.702810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:29.702676    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdl82\" (UniqueName: \"kubernetes.io/projected/0ca1e799-3b61-4931-bebb-17513a8edd0e-kube-api-access-zdl82\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:14:30.155533 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.155497    6126 generic.go:356] "Generic (PLEG): container finished" podID="0ca1e799-3b61-4931-bebb-17513a8edd0e" containerID="f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a" exitCode=0
Oct 31 00:14:30.155742 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.155555    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" event={"ID":"0ca1e799-3b61-4931-bebb-17513a8edd0e","Type":"ContainerDied","Data":"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"}
Oct 31 00:14:30.155742 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.155556    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"
Oct 31 00:14:30.155742 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.155647    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9" event={"ID":"0ca1e799-3b61-4931-bebb-17513a8edd0e","Type":"ContainerDied","Data":"a814e1c4cbfd8bea8adf04d0351b857334f24ac2d3c9f82052f874e2599792ea"}
Oct 31 00:14:30.155742 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.155671    6126 scope.go:122] "RemoveContainer" containerID="f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"
Oct 31 00:14:30.168903 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.168879    6126 scope.go:122] "RemoveContainer" containerID="f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"
Oct 31 00:14:30.169421 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:14:30.169390    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a\": container with ID starting with f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a not found: ID does not exist" containerID="f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"
Oct 31 00:14:30.169524 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.169431    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a"} err="failed to get container status \"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a\": rpc error: code = NotFound desc = could not find container \"f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a\": container with ID starting with f4e173052517696df930c84893f280c2b2e9deb0afe409bb2f5e762ff6709f5a not found: ID does not exist"
Oct 31 00:14:30.320662 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.320628    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 31 00:14:30.370808 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.370768    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b8bf64d7-mb2g9"]
Oct 31 00:14:30.406224 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:30.406134    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ca1e799-3b61-4931-bebb-17513a8edd0e" path="/var/lib/kubelet/pods/0ca1e799-3b61-4931-bebb-17513a8edd0e/volumes"
Oct 31 00:14:34.149368 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:14:34.149332    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:14:34.375475 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.375440    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:14:34.376008 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.375992    6126 cpu_manager.go:414] "containerMap: removing container" podUID="0ca1e799-3b61-4931-bebb-17513a8edd0e" containerName="maas-api"
Oct 31 00:14:34.376053 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.376010    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ca1e799-3b61-4931-bebb-17513a8edd0e" containerName="maas-api"
Oct 31 00:14:34.376107 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.376097    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ca1e799-3b61-4931-bebb-17513a8edd0e" containerName="maas-api"
Oct 31 00:14:34.380784 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.380764    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.435444 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.435370    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:14:34.453681 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.453648    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.454076 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.454046    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmbt\" (UniqueName: \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.483290 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.483265    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4145bafc\""
Oct 31 00:14:34.483436 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.483415    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4145bafc-dockercfg-rrvwt\""
Oct 31 00:14:34.555722 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.555690    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmbt\" (UniqueName: \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.555907 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.555841    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.556486 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.556468    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.613424 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.613386    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmbt\" (UniqueName: \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\") pod \"payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.694488 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.694404    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:34.962394 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.962325    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:14:34.967274 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:34.967252    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.021438 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.021405    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4145bafc-serving-cert\""
Oct 31 00:14:35.024164 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.024133    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:14:35.061196 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.061166    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.061371 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.061245    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdd8\" (UniqueName: \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.061442 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.061384    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.061517 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.061499    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.074537 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.074511    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:14:35.077210 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:14:35.077179    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3a9612_455d_49cb_ad3c_cacf8ad88b99.slice/crio-f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92 WatchSource:0}: Error finding container f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92: Status 404 returned error can't find the container with id f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92
Oct 31 00:14:35.162985 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.162958    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.163326 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.163018    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.163326 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.163060    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.163326 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:14:35.163108    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-serving-cert: secret "maas-api-e2e-ait-4145bafc-serving-cert" not found
Oct 31 00:14:35.163326 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.163133    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdd8\" (UniqueName: \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.163326 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:14:35.163169    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls podName:7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef nodeName:}" failed. No retries permitted until 2026-10-31 00:14:35.663149055 +0000 UTC m=+4047.423241620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls") pod "maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" (UID: "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef") : secret "maas-api-e2e-ait-4145bafc-serving-cert" not found
Oct 31 00:14:35.163735 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.163717    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.165469 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.165450    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.188464 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.188427    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" event={"ID":"cc3a9612-455d-49cb-ad3c-cacf8ad88b99","Type":"ContainerStarted","Data":"52515147f5f86ec84656e237b1447da1f479fa3a03eb71c133c72297038989cf"}
Oct 31 00:14:35.188602 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.188496    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" event={"ID":"cc3a9612-455d-49cb-ad3c-cacf8ad88b99","Type":"ContainerStarted","Data":"f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92"}
Oct 31 00:14:35.188602 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.188527    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:14:35.223288 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.223252    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdd8\" (UniqueName: \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.305536 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.305477    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" podStartSLOduration=1.305462743 podStartE2EDuration="1.305462743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:35.302963026 +0000 UTC m=+4047.063055598" watchObservedRunningTime="2026-10-31 00:14:35.305462743 +0000 UTC m=+4047.065555347"
Oct 31 00:14:35.669163 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.669061    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.671729 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.671695    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") pod \"maas-api-e2e-ait-4145bafc-6cf598f79f-whklc\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:35.888152 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:35.888120    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:36.315519 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:36.315491    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:14:36.317992 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:14:36.317966    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8aeed6_d2ed_4f32_addf_f8f4f2c636ef.slice/crio-54fe64c40011bb47160a68123f20920d3a926315edf54628da73f44eff7bd6f5 WatchSource:0}: Error finding container 54fe64c40011bb47160a68123f20920d3a926315edf54628da73f44eff7bd6f5: Status 404 returned error can't find the container with id 54fe64c40011bb47160a68123f20920d3a926315edf54628da73f44eff7bd6f5
Oct 31 00:14:37.201190 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:37.201161    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" event={"ID":"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef","Type":"ContainerStarted","Data":"54fe64c40011bb47160a68123f20920d3a926315edf54628da73f44eff7bd6f5"}
Oct 31 00:14:38.212061 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:38.212029    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" event={"ID":"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef","Type":"ContainerStarted","Data":"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"}
Oct 31 00:14:38.212532 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:38.212095    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:38.330388 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:38.330329    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" podStartSLOduration=3.499076794 podStartE2EDuration="4.330314083s" totalImagesPullingTime="831.237289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:38.328656561 +0000 UTC m=+4050.088749133" watchObservedRunningTime="2026-10-31 00:14:38.330314083 +0000 UTC m=+4050.090406655"
Oct 31 00:14:44.222226 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:44.222197    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:14:46.198268 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:14:46.198184    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:15:04.150161 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:15:04.150121    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:15:08.162089 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:08.162055    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:15:13.162883 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.162814    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" podUID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" containerName="payload-pre-processing" containerID="cri-o://52515147f5f86ec84656e237b1447da1f479fa3a03eb71c133c72297038989cf" gracePeriod=25
Oct 31 00:15:13.417233 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.417144    6126 generic.go:356] "Generic (PLEG): container finished" podID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" containerID="52515147f5f86ec84656e237b1447da1f479fa3a03eb71c133c72297038989cf" exitCode=0
Oct 31 00:15:13.417233 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.417217    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" event={"ID":"cc3a9612-455d-49cb-ad3c-cacf8ad88b99","Type":"ContainerDied","Data":"52515147f5f86ec84656e237b1447da1f479fa3a03eb71c133c72297038989cf"}
Oct 31 00:15:13.417436 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.417269    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t" event={"ID":"cc3a9612-455d-49cb-ad3c-cacf8ad88b99","Type":"ContainerDied","Data":"f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92"}
Oct 31 00:15:13.417436 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.417285    6126 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5e9b38ef2934585a7a7cf859e92a1ec98058ba2c802aaeda67742f5edd1ce92"
Oct 31 00:15:13.425013 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.424971    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:15:13.578475 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.578444    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\" (UniqueName: \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\") pod \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") "
Oct 31 00:15:13.578693 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.578507    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\") pod \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\" (UID: \"cc3a9612-455d-49cb-ad3c-cacf8ad88b99\") "
Oct 31 00:15:13.578918 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.578896    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume" pod "cc3a9612-455d-49cb-ad3c-cacf8ad88b99" (UID: "cc3a9612-455d-49cb-ad3c-cacf8ad88b99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:13.580831 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.580807    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt" pod "cc3a9612-455d-49cb-ad3c-cacf8ad88b99" (UID: "cc3a9612-455d-49cb-ad3c-cacf8ad88b99"). InnerVolumeSpecName "kube-api-access-4vmbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:13.679729 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.679599    6126 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-plugins-config-volume\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:13.679729 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:13.679672    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vmbt\" (UniqueName: \"kubernetes.io/projected/cc3a9612-455d-49cb-ad3c-cacf8ad88b99-kube-api-access-4vmbt\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:14.422067 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.422040    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"
Oct 31 00:15:14.587905 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.587868    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:15:14.639655 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.639589    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4145bafc-748d4776c9-csh4t"]
Oct 31 00:15:14.642292 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.642264    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:15:14.642582 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.642555    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" podUID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" containerName="maas-api" containerID="cri-o://ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac" gracePeriod=30
Oct 31 00:15:14.906293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.906265    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:15:14.994353 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.994320    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") pod \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") "
Oct 31 00:15:14.994532 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.994377    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\") pod \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") "
Oct 31 00:15:14.994532 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.994433    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\" (UniqueName: \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\") pod \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") "
Oct 31 00:15:14.994532 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.994475    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\") pod \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\" (UID: \"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef\") "
Oct 31 00:15:14.994998 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.994963    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca" pod "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" (UID: "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:14.996707 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.996676    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls" pod "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" (UID: "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:14.996810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.996761    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs" pod "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" (UID: "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:14.996810 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:14.996770    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8" pod "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" (UID: "7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef"). InnerVolumeSpecName "kube-api-access-2rdd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:15.096471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.096386    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:15.096471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.096418    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:15.096471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.096429    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rdd8\" (UniqueName: \"kubernetes.io/projected/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-kube-api-access-2rdd8\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:15.096471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.096439    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:15:15.429272 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.429175    6126 generic.go:356] "Generic (PLEG): container finished" podID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" containerID="ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac" exitCode=0
Oct 31 00:15:15.429272 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.429235    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"
Oct 31 00:15:15.429272 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.429246    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" event={"ID":"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef","Type":"ContainerDied","Data":"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"}
Oct 31 00:15:15.429895 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.429287    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc" event={"ID":"7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef","Type":"ContainerDied","Data":"54fe64c40011bb47160a68123f20920d3a926315edf54628da73f44eff7bd6f5"}
Oct 31 00:15:15.429895 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.429307    6126 scope.go:122] "RemoveContainer" containerID="ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"
Oct 31 00:15:15.444386 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.444361    6126 scope.go:122] "RemoveContainer" containerID="ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"
Oct 31 00:15:15.444799 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:15:15.444765    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac\": container with ID starting with ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac not found: ID does not exist" containerID="ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"
Oct 31 00:15:15.444936 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.444810    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac"} err="failed to get container status \"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac\": rpc error: code = NotFound desc = could not find container \"ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac\": container with ID starting with ae1ab086978bacd3506061ed35d1ee318d2116d800f82eab28162375efe75eac not found: ID does not exist"
Oct 31 00:15:15.594844 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.594813    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:15:15.644650 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:15.644604    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4145bafc-6cf598f79f-whklc"]
Oct 31 00:15:16.406486 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:16.406449    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" path="/var/lib/kubelet/pods/7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef/volumes"
Oct 31 00:15:16.406898 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:16.406883    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" path="/var/lib/kubelet/pods/cc3a9612-455d-49cb-ad3c-cacf8ad88b99/volumes"
Oct 31 00:15:26.266548 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.266511    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:15:26.267279 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267259    6126 cpu_manager.go:414] "containerMap: removing container" podUID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" containerName="payload-pre-processing"
Oct 31 00:15:26.267382 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267280    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" containerName="payload-pre-processing"
Oct 31 00:15:26.267382 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267318    6126 cpu_manager.go:414] "containerMap: removing container" podUID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" containerName="maas-api"
Oct 31 00:15:26.267382 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267326    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" containerName="maas-api"
Oct 31 00:15:26.267544 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267500    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc3a9612-455d-49cb-ad3c-cacf8ad88b99" containerName="payload-pre-processing"
Oct 31 00:15:26.267544 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.267521    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d8aeed6-d2ed-4f32-addf-f8f4f2c636ef" containerName="maas-api"
Oct 31 00:15:26.272315 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.272293    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.326769 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.326688    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-1d38f4-serving-cert\""
Oct 31 00:15:26.379064 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.379027    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:15:26.417021 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.416984    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.417246 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.417205    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.417331 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.417310    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.417393 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.417367    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4j56\" (UniqueName: \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.519186 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.519069    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.519334 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.519212    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.519334 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.519257    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4j56\" (UniqueName: \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.519451 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.519359    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.519451 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:15:26.519371    6126 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-serving-cert: secret "maas-api-e2e-authcfg-http-1d38f4-serving-cert" not found
Oct 31 00:15:26.519451 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:15:26.519447    6126 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls podName:562a6c71-c8a3-486c-b472-b5ffd41d4a4a nodeName:}" failed. No retries permitted until 2026-10-31 00:15:27.019424525 +0000 UTC m=+4098.779517090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls") pod "maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" (UID: "562a6c71-c8a3-486c-b472-b5ffd41d4a4a") : secret "maas-api-e2e-authcfg-http-1d38f4-serving-cert" not found
Oct 31 00:15:26.520374 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.520350    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.521984 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.521961    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:26.578507 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:26.578472    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4j56\" (UniqueName: \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:27.025395 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:27.025330    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:27.028604 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:27.028574    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:27.187673 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:27.187633    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:27.566994 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:27.566967    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:15:27.569728 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:15:27.569689    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562a6c71_c8a3_486c_b472_b5ffd41d4a4a.slice/crio-bfe62293d1b41addf51da21fc330f062512476158a42251363bd10086ae59b73 WatchSource:0}: Error finding container bfe62293d1b41addf51da21fc330f062512476158a42251363bd10086ae59b73: Status 404 returned error can't find the container with id bfe62293d1b41addf51da21fc330f062512476158a42251363bd10086ae59b73
Oct 31 00:15:28.518276 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:28.518225    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" event={"ID":"562a6c71-c8a3-486c-b472-b5ffd41d4a4a","Type":"ContainerStarted","Data":"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"}
Oct 31 00:15:28.518487 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:28.518298    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" event={"ID":"562a6c71-c8a3-486c-b472-b5ffd41d4a4a","Type":"ContainerStarted","Data":"bfe62293d1b41addf51da21fc330f062512476158a42251363bd10086ae59b73"}
Oct 31 00:15:28.518487 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:28.518331    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:15:28.643055 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:28.642935    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" podStartSLOduration=1.8550753850000001 podStartE2EDuration="2.642915704s" totalImagesPullingTime="787.840319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:28.642547023 +0000 UTC m=+4100.402639594" watchObservedRunningTime="2026-10-31 00:15:28.642915704 +0000 UTC m=+4100.403008275"
Oct 31 00:15:34.151026 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:15:34.150984    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:15:34.528782 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:15:34.528752    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:16:04.150382 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:16:04.150348    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:16:34.150101 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:16:34.150065    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:17:04.150559 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:17:04.150517    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:17:09.168468 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:09.168439    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:17:09.189054 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:09.189029    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x2kt_5f02514a-3fb9-4bce-adec-87f1e75304a7/ovn-acl-logging/0.log"
Oct 31 00:17:27.780069 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:27.780033    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:17:27.780512 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:27.780259    6126 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" podUID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" containerName="maas-api" containerID="cri-o://589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d" gracePeriod=30
Oct 31 00:17:28.042038 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.041982    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:17:28.154138 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.154098    6126 generic.go:356] "Generic (PLEG): container finished" podID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" containerID="589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d" exitCode=0
Oct 31 00:17:28.154293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.154153    6126 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"
Oct 31 00:17:28.154293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.154157    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" event={"ID":"562a6c71-c8a3-486c-b472-b5ffd41d4a4a","Type":"ContainerDied","Data":"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"}
Oct 31 00:17:28.154293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.154210    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk" event={"ID":"562a6c71-c8a3-486c-b472-b5ffd41d4a4a","Type":"ContainerDied","Data":"bfe62293d1b41addf51da21fc330f062512476158a42251363bd10086ae59b73"}
Oct 31 00:17:28.154293 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.154239    6126 scope.go:122] "RemoveContainer" containerID="589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"
Oct 31 00:17:28.165207 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.165177    6126 scope.go:122] "RemoveContainer" containerID="589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"
Oct 31 00:17:28.165685 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:17:28.165658    6126 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d\": container with ID starting with 589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d not found: ID does not exist" containerID="589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"
Oct 31 00:17:28.165819 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.165696    6126 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d"} err="failed to get container status \"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d\": rpc error: code = NotFound desc = could not find container \"589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d\": container with ID starting with 589c35809961342c648790c43a76cb0523700026830b1f90931c53441331a79d not found: ID does not exist"
Oct 31 00:17:28.178888 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.178856    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\") pod \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") "
Oct 31 00:17:28.179066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.178943    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\") pod \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") "
Oct 31 00:17:28.179066 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.178992    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\" (UniqueName: \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\") pod \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") "
Oct 31 00:17:28.179181 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.179163    6126 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") pod \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\" (UID: \"562a6c71-c8a3-486c-b472-b5ffd41d4a4a\") "
Oct 31 00:17:28.179659 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.179524    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca" pod "562a6c71-c8a3-486c-b472-b5ffd41d4a4a" (UID: "562a6c71-c8a3-486c-b472-b5ffd41d4a4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:17:28.182100 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.182070    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56" pod "562a6c71-c8a3-486c-b472-b5ffd41d4a4a" (UID: "562a6c71-c8a3-486c-b472-b5ffd41d4a4a"). InnerVolumeSpecName "kube-api-access-x4j56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:17:28.182217 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.182120    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls" pod "562a6c71-c8a3-486c-b472-b5ffd41d4a4a" (UID: "562a6c71-c8a3-486c-b472-b5ffd41d4a4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:17:28.183382 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.183356    6126 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs" pod "562a6c71-c8a3-486c-b472-b5ffd41d4a4a" (UID: "562a6c71-c8a3-486c-b472-b5ffd41d4a4a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:17:28.280458 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.280425    6126 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-openshift-service-ca\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:17:28.280458 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.280452    6126 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-metrics-certs\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:17:28.280458 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.280462    6126 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4j56\" (UniqueName: \"kubernetes.io/projected/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-kube-api-access-x4j56\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:17:28.280760 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.280471    6126 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/562a6c71-c8a3-486c-b472-b5ffd41d4a4a-maas-api-tls\") on node \"ip-10-0-133-110.us-west-1.compute.internal\" DevicePath \"\""
Oct 31 00:17:28.569811 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.569754    6126 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:17:28.571719 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:28.571695    6126 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-1d38f4-56499d859b-mzmpk"]
Oct 31 00:17:30.405764 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:17:30.405729    6126 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" path="/var/lib/kubelet/pods/562a6c71-c8a3-486c-b472-b5ffd41d4a4a/volumes"
Oct 31 00:17:34.150740 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:17:34.150701    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:18:04.150844 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:18:04.150764    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:18:24.396643 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:18:24.393729    6126 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-9w978 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:18:24.396643 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:18:24.393828    6126 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-9w978" podUID="09235097-5c80-4957-9797-688819394a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:18:34.151208 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:18:34.151164    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:18:57.977172 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:18:57.977141    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-7d9cf87f9b-rm5mx_6f0adc7e-dab8-42ae-a782-bc626a786068/manager/0.log"
Oct 31 00:18:58.344532 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:18:58.344446    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-2t6l6_78b79eb4-f7a2-4464-a9fb-e2a32c1596be/manager/0.log"
Oct 31 00:18:58.570544 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:18:58.570510    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zwhz5_11ff1ce3-0442-47e8-8da7-f38df20493bf/manager/0.log"
Oct 31 00:19:00.204716 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:00.204685    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-l4fk5_558f28f0-3880-4c97-823c-f1d8f9b21f14/manager/0.log"
Oct 31 00:19:01.293257 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:01.293225    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85b64959d7-hnbh2_7e71d396-6246-4c56-bb53-0e2a8f407c38/maas-api/0.log"
Oct 31 00:19:04.151609 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:19:04.151571    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:19:05.308082 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:05.308051    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jzsf4_79396f50-5c0f-4a74-a4a3-91934f588725/manager/0.log"
Oct 31 00:19:07.430394 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:07.430366    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bd9cf9d49-b4brk_e15b730c-ea62-4f64-8518-6834c439a0a0/kube-auth-proxy/0.log"
Oct 31 00:19:08.820266 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:08.820229    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-75r4c_025d9e91-ef8a-47fa-a680-3ef99f6931c5/istio-proxy/0.log"
Oct 31 00:19:09.078814 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:09.078732    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-9w978_09235097-5c80-4957-9797-688819394a19/istio-proxy/0.log"
Oct 31 00:19:09.541269 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:09.541242    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-spb8t_3a52a48a-233b-488b-bd22-12cddbc35491/istio-proxy/0.log"
Oct 31 00:19:10.206426 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:10.206402    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-f82lh_50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb/payload-pre-processing/0.log"
Oct 31 00:19:10.428387 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:10.428360    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:19:11.709884 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:11.709854    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm_5b9b407f-c259-48fd-b0bd-dfa6af481475/main/0.log"
Oct 31 00:19:11.982087 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:11.982058    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9sngd_08cdd497-eb0a-4992-a697-4645a9730e07/main/0.log"
Oct 31 00:19:12.432741 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:12.432665    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-nhl75_1b737fd3-97c2-4405-8875-9b198e94df4a/main/0.log"
Oct 31 00:19:12.656768 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:12.656742    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl_9f67f360-db37-4061-83e9-d95856cd2252/main/0.log"
Oct 31 00:19:13.105417 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:13.105384    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98_2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541/main/0.log"
Oct 31 00:19:23.501709 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:23.501581    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-7d9cf87f9b-rm5mx_6f0adc7e-dab8-42ae-a782-bc626a786068/manager/0.log"
Oct 31 00:19:23.871379 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:23.871287    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-2t6l6_78b79eb4-f7a2-4464-a9fb-e2a32c1596be/manager/0.log"
Oct 31 00:19:24.084779 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:24.084745    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zwhz5_11ff1ce3-0442-47e8-8da7-f38df20493bf/manager/0.log"
Oct 31 00:19:25.282186 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:25.282148    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-l4fk5_558f28f0-3880-4c97-823c-f1d8f9b21f14/manager/0.log"
Oct 31 00:19:26.141529 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:26.141479    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85b64959d7-hnbh2_7e71d396-6246-4c56-bb53-0e2a8f407c38/maas-api/0.log"
Oct 31 00:19:29.532888 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:29.532854    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jzsf4_79396f50-5c0f-4a74-a4a3-91934f588725/manager/0.log"
Oct 31 00:19:31.339692 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:31.339663    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bd9cf9d49-b4brk_e15b730c-ea62-4f64-8518-6834c439a0a0/kube-auth-proxy/0.log"
Oct 31 00:19:32.724068 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:32.724037    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-75r4c_025d9e91-ef8a-47fa-a680-3ef99f6931c5/istio-proxy/0.log"
Oct 31 00:19:32.986922 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:32.986843    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-9w978_09235097-5c80-4957-9797-688819394a19/istio-proxy/0.log"
Oct 31 00:19:33.426915 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:33.426831    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-spb8t_3a52a48a-233b-488b-bd22-12cddbc35491/istio-proxy/0.log"
Oct 31 00:19:34.118298 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:34.118268    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-f82lh_50879613-3ffe-45d0-ba4b-1a9bfbf8ebcb/payload-pre-processing/0.log"
Oct 31 00:19:34.149895 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:19:34.149863    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:19:34.342030 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:34.342004    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:19:35.143205 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:35.143173    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-dxpbm_5b9b407f-c259-48fd-b0bd-dfa6af481475/main/0.log"
Oct 31 00:19:35.364000 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:35.363966    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9sngd_08cdd497-eb0a-4992-a697-4645a9730e07/main/0.log"
Oct 31 00:19:35.863094 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:35.863067    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-nhl75_1b737fd3-97c2-4405-8875-9b198e94df4a/main/0.log"
Oct 31 00:19:36.066927 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:36.066895    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8lr6rl_9f67f360-db37-4061-83e9-d95856cd2252/main/0.log"
Oct 31 00:19:36.505534 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:19:36.505498    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-pcc98_2a5cd83c-bf2a-469f-b2d3-a4dd93ff9541/main/0.log"
Oct 31 00:20:04.153788 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:20:04.153746    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:20:08.666900 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:20:08.666869    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:20:08.882336 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:20:08.882309    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:20:34.150122 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:20:34.150075    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:20:48.752598 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:20:48.752525    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:20:48.961273 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:20:48.961242    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-ntr8w_89296a50-177e-485c-b1c3-4a7551984d90/payload-processing/0.log"
Oct 31 00:20:58.452830 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:20:58.452786    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6wk6h_fd46d589-b55e-4971-9abc-1595f7d4a900/global-pull-secret-syncer/0.log"
Oct 31 00:21:02.456675 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:02.456643    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jqqzd_e729c6bb-7337-4107-9833-b75ca14a82ab/konnectivity-agent/0.log"
Oct 31 00:21:03.696300 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:03.696266    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-110.us-west-1.compute.internal_a483a0a2f224f7b88a6328294b47ee65/haproxy/0.log"
Oct 31 00:21:04.149541 ip-10-0-133-110 kubenswrapper[6126]: E1031 00:21:04.149509    6126 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bwwqq" containerName="extractor"
Oct 31 00:21:08.300660 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.300628    6126 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"]
Oct 31 00:21:08.301379 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.301357    6126 cpu_manager.go:414] "containerMap: removing container" podUID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" containerName="maas-api"
Oct 31 00:21:08.301457 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.301381    6126 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" containerName="maas-api"
Oct 31 00:21:08.301515 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.301509    6126 memory_manager.go:365] "RemoveStaleState removing state" podUID="562a6c71-c8a3-486c-b472-b5ffd41d4a4a" containerName="maas-api"
Oct 31 00:21:08.305202 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.305180    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.306027 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.305983    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsg7h\" (UniqueName: \"kubernetes.io/projected/ea1f9f3c-7404-4215-a793-6b6438d4dec0-kube-api-access-rsg7h\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.306159 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.306059    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-podres\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.306159 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.306085    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-sys\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.306159 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.306114    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-proc\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.306326 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.306213    6126 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-lib-modules\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.360577 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.360549    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"]
Oct 31 00:21:08.406793 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406764    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg7h\" (UniqueName: \"kubernetes.io/projected/ea1f9f3c-7404-4215-a793-6b6438d4dec0-kube-api-access-rsg7h\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.406960 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406802    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-podres\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.406960 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406828    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-sys\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.406960 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406865    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-proc\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.406960 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406895    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-podres\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.406960 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406897    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-sys\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.407214 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406961    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-proc\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.407214 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.406986    6126 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-lib-modules\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.407214 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.407029    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea1f9f3c-7404-4215-a793-6b6438d4dec0-lib-modules\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.408750 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.408728    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d5xbs\"/\"openshift-service-ca.crt\""
Oct 31 00:21:08.408849 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.408813    6126 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d5xbs\"/\"default-dockercfg-xrnc4\""
Oct 31 00:21:08.408849 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.408817    6126 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d5xbs\"/\"kube-root-ca.crt\""
Oct 31 00:21:08.464061 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.464028    6126 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsg7h\" (UniqueName: \"kubernetes.io/projected/ea1f9f3c-7404-4215-a793-6b6438d4dec0-kube-api-access-rsg7h\") pod \"perf-node-gather-daemonset-52bcg\" (UID: \"ea1f9f3c-7404-4215-a793-6b6438d4dec0\") " pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.618201 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.618121    6126 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:08.988471 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:08.988446    6126 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"]
Oct 31 00:21:08.991309 ip-10-0-133-110 kubenswrapper[6126]: W1031 00:21:08.991285    6126 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea1f9f3c_7404_4215_a793_6b6438d4dec0.slice/crio-1ff337297c156f6eae7520705c24875dddbacaa973b651f542a7ac071d83be4f WatchSource:0}: Error finding container 1ff337297c156f6eae7520705c24875dddbacaa973b651f542a7ac071d83be4f: Status 404 returned error can't find the container with id 1ff337297c156f6eae7520705c24875dddbacaa973b651f542a7ac071d83be4f
Oct 31 00:21:09.462303 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.462216    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg" event={"ID":"ea1f9f3c-7404-4215-a793-6b6438d4dec0","Type":"ContainerStarted","Data":"8ab67eb908d46597dd23f3f7bff23e1459707433426f5a1f03a474d4367de189"}
Oct 31 00:21:09.462703 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.462303    6126 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg" event={"ID":"ea1f9f3c-7404-4215-a793-6b6438d4dec0","Type":"ContainerStarted","Data":"1ff337297c156f6eae7520705c24875dddbacaa973b651f542a7ac071d83be4f"}
Oct 31 00:21:09.462703 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.462445    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:09.578192 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.578145    6126 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg" podStartSLOduration=1.57813143 podStartE2EDuration="1.57813143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:09.577083945 +0000 UTC m=+4441.337176517" watchObservedRunningTime="2026-10-31 00:21:09.57813143 +0000 UTC m=+4441.338224000"
Oct 31 00:21:09.608161 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.608137    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jzsf4_79396f50-5c0f-4a74-a4a3-91934f588725/manager/0.log"
Oct 31 00:21:09.876006 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:09.875975    6126 scope.go:122] "RemoveContainer" containerID="52515147f5f86ec84656e237b1447da1f479fa3a03eb71c133c72297038989cf"
Oct 31 00:21:13.107297 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:13.107265    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/alertmanager/0.log"
Oct 31 00:21:13.523718 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:13.523680    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/config-reloader/0.log"
Oct 31 00:21:13.940664 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:13.940571    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/kube-rbac-proxy-web/0.log"
Oct 31 00:21:14.360882 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:14.360851    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/kube-rbac-proxy/0.log"
Oct 31 00:21:14.781761 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:14.781732    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/kube-rbac-proxy-metric/0.log"
Oct 31 00:21:15.201426 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:15.201351    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/prom-label-proxy/0.log"
Oct 31 00:21:15.478748 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:15.478721    6126 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d5xbs/perf-node-gather-daemonset-52bcg"
Oct 31 00:21:15.622659 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:15.622607    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37cdb494-de14-49e2-a739-75537cb8c9ad/init-config-reloader/0.log"
Oct 31 00:21:16.515208 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:16.515183    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-wtbcz_bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/kube-state-metrics/0.log"
Oct 31 00:21:16.930352 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:16.930280    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-wtbcz_bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/kube-rbac-proxy-main/0.log"
Oct 31 00:21:17.348381 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:17.348354    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-wtbcz_bcdb7fa1-ffb5-4147-81a9-fd6c4bcff234/kube-rbac-proxy-self/0.log"
Oct 31 00:21:17.769657 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:17.769632    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dcddbd87f-zwc2x_a25f7043-d8b2-4e7b-a8f7-7ebac76c86fe/metrics-server/0.log"
Oct 31 00:21:18.189626 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:18.189547    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-cr55m_1fff5edd-ad77-4f60-8b68-007782672512/monitoring-plugin/0.log"
Oct 31 00:21:18.615675 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:18.615647    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pjh2_201241b0-a25e-4c89-9d64-c33bde6637c1/node-exporter/0.log"
Oct 31 00:21:19.032828 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:19.032800    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pjh2_201241b0-a25e-4c89-9d64-c33bde6637c1/kube-rbac-proxy/0.log"
Oct 31 00:21:19.454421 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:19.454356    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pjh2_201241b0-a25e-4c89-9d64-c33bde6637c1/init-textfile/0.log"
Oct 31 00:21:22.417573 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:22.417539    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqwj8_a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/kube-rbac-proxy-main/0.log"
Oct 31 00:21:22.835630 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:22.835579    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqwj8_a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/kube-rbac-proxy-self/0.log"
Oct 31 00:21:23.255854 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:23.255823    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqwj8_a50d5730-1bd4-4cea-8915-4a7d9ba6fc02/openshift-state-metrics/0.log"
Oct 31 00:21:23.687502 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:23.687422    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/prometheus/0.log"
Oct 31 00:21:24.107469 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:24.107441    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/config-reloader/0.log"
Oct 31 00:21:24.526251 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:24.526219    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/thanos-sidecar/0.log"
Oct 31 00:21:24.946396 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:24.946309    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/kube-rbac-proxy-web/0.log"
Oct 31 00:21:25.366666 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:25.366633    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/kube-rbac-proxy/0.log"
Oct 31 00:21:25.796133 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:25.796105    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/kube-rbac-proxy-thanos/0.log"
Oct 31 00:21:26.216768 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:26.216676    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a48d391a-95b3-480f-8a83-ade82f576158/init-config-reloader/0.log"
Oct 31 00:21:26.643409 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:26.643332    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-xgh98_389f431d-8f1c-4f9c-8cac-e270a08b731a/prometheus-operator/0.log"
Oct 31 00:21:27.060150 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:27.060114    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-xgh98_389f431d-8f1c-4f9c-8cac-e270a08b731a/kube-rbac-proxy/0.log"
Oct 31 00:21:27.481767 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:27.481733    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-2fm7f_afdd3a1c-cea6-480a-b43f-adf808299dde/prometheus-operator-admission-webhook/0.log"
Oct 31 00:21:27.908229 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:27.908142    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb769446-4pf69_5961be49-a9c6-44f7-9c9a-ec04c0dc7226/telemeter-client/0.log"
Oct 31 00:21:28.331555 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:28.331529    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb769446-4pf69_5961be49-a9c6-44f7-9c9a-ec04c0dc7226/reload/0.log"
Oct 31 00:21:28.749139 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:28.749115    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb769446-4pf69_5961be49-a9c6-44f7-9c9a-ec04c0dc7226/kube-rbac-proxy/0.log"
Oct 31 00:21:29.174188 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:29.174114    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/thanos-query/0.log"
Oct 31 00:21:29.590562 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:29.590540    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/kube-rbac-proxy-web/0.log"
Oct 31 00:21:30.007728 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:30.007701    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/kube-rbac-proxy/0.log"
Oct 31 00:21:30.428556 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:30.428479    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/prom-label-proxy/0.log"
Oct 31 00:21:30.849305 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:30.849253    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/kube-rbac-proxy-rules/0.log"
Oct 31 00:21:31.266358 ip-10-0-133-110 kubenswrapper[6126]: I1031 00:21:31.266326    6126 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8f9bc4d-56t2q_64763c7a-6a43-4764-9fc5-b1e16d1f6c80/kube-rbac-proxy-metrics/0.log"