Oct 30 21:43:58.021965 ip-10-0-130-176 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:43:58.362200 ip-10-0-130-176 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:58.362200 ip-10-0-130-176 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:43:58.362200 ip-10-0-130-176 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:58.362200 ip-10-0-130-176 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:58.366141 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366059    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.366141 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366142    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366145    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366149    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366151    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366154    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366157    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366160    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366163    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366165    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366168    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366171    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366173    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366176    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366178    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366195    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366198    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366201    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366204    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366207    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366210    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.366224 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366213    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366215    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366218    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366221    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366223    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366226    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366229    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366232    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366235    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366238    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366241    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366243    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366245    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366248    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366251    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366253    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366255    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366258    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366260    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.366813 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366262    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366265    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366267    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366270    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366272    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366274    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366277    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366279    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366282    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366285    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366287    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366289    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366292    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366294    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366298    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366301    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366303    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366306    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366309    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366311    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.367585 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366314    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366316    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366319    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366321    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366324    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366326    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366328    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366331    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366333    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366336    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366338    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366341    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366344    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366346    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366350    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366354    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366358    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366360    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366363    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.368171 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366365    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366368    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366370    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366373    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366376    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366378    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366380    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366383    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366386    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366389    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366392    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366394    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366397    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366399    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366402    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366404    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366407    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366409    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366412    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.368642 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366414    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366418    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366422    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366425    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366427    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366432    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366434    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.366437    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368334    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368347    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368351    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368355    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368357    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368360    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368363    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368366    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368368    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368371    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368374    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368376    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.369083 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368379    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368382    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368385    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368387    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368390    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368392    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368395    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368397    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368399    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368402    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368404    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368407    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368410    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368412    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368415    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368417    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368420    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368423    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368426    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368429    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.369639 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368431    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368434    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368437    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368439    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368442    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368444    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368448    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368451    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368454    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368456    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368459    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368462    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368464    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368467    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368469    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368472    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368474    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368477    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368486    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.370113 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368489    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368492    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368494    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368497    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368499    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368502    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368504    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368506    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368509    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368513    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368516    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368520    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368522    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368525    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368529    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368534    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368538    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368542    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368546    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.370578 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368549    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368551    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368554    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368556    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368559    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368563    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368566    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368570    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368574    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368576    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368579    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368581    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368584    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368592    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368595    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368597    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368600    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368602    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368604    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.371032 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368607    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368610    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368612    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368615    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368618    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368620    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368623    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368628    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368631    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368633    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368636    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368639    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368642    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368644    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368647    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368650    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.368653    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369159    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369164    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369167    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.371508 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369169    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369172    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369175    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369177    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369180    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369197    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369201    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369204    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369207    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369209    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369212    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369214    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369217    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369219    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369222    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369224    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369227    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369230    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369233    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369237    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.371963 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369240    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369244    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369247    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369251    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369254    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369257    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369260    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369262    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369265    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369267    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369269    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369272    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369275    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369277    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369280    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369282    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369285    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369287    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369290    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369293    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.372439 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369295    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369298    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369300    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369303    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369305    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369308    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369310    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369313    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369315    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369318    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369321    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369324    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369327    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369329    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369331    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369334    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369336    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369339    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369341    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369344    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.372910 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369346    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369348    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369351    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369353    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369357    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369361    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369364    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369366    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369369    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369371    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369374    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369376    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369379    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369381    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369384    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369386    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369389    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369392    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369394    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.373386 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369397    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369400    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369402    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369405    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369409    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369411    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369414    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369416    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369419    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369421    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369424    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369426    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369429    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369431    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369434    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369436    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369439    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369441    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369444    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.373821 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369446    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369449    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369451    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369453    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.369457    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370260    2578 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370271    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370279    2578 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370284    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370289    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370292    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370297    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370303    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370306    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370309    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370312    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370316    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370319    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370323    2578 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370326    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370328    2578 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370331    2578 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370334    2578 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:43:58.374274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370339    2578 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370341    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370344    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370347    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370351    2578 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370354    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370358    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370361    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370364    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370367    2578 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370370    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370373    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370376    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370378    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370383    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370386    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370389    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370392    2578 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370395    2578 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370398    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370402    2578 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370406    2578 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370409    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370412    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:43:58.374811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370415    2578 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370420    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370423    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370426    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370430    2578 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370433    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370436    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370438    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370442    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370445    2578 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370448    2578 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370450    2578 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370454    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370457    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370461    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370464    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370467    2578 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370470    2578 flags.go:64] FLAG: --help="false"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370473    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370476    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370479    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370482    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370485    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:43:58.375448 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370488    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370491    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370494    2578 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370498    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370500    2578 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370503    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370507    2578 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370510    2578 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370513    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370516    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370519    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370521    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370524    2578 flags.go:64] FLAG: --lock-file=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370527    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370530    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370533    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370539    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370541    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370544    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370547    2578 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370550    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370553    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370556    2578 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370559    2578 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370564    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:43:58.375991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370567    2578 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370571    2578 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370573    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370576    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370579    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370582    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370585    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370588    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370591    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370598    2578 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370601    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370604    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370608    2578 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370613    2578 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370615    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370619    2578 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370621    2578 flags.go:64] FLAG: --port="10250"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370625    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370628    2578 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-02c91fd2e98a650db"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370631    2578 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370634    2578 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370637    2578 flags.go:64] FLAG: --register-node="true"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370640    2578 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370644    2578 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370647    2578 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370650    2578 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:43:58.376584 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370652    2578 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370656    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370659    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370662    2578 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370665    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370668    2578 flags.go:64] FLAG: --runonce="false"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370671    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370674    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370677    2578 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370680    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370682    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370686    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370689    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370692    2578 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370695    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370698    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370700    2578 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370703    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370708    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370712    2578 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370715    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370720    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370723    2578 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370727    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370731    2578 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:43:58.377331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370734    2578 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370736    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370739    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370742    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370745    2578 flags.go:64] FLAG: --v="2"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370749    2578 flags.go:64] FLAG: --version="false"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370753    2578 flags.go:64] FLAG: --vmodule=""
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370757    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.370761    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370898    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370901    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370905    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370908    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370910    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370913    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370915    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370918    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370920    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370923    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370925    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370928    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370931    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.377916 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370933    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370936    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370938    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370941    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370945    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370948    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370950    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370953    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370957    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370959    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370962    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370964    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370967    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370969    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370972    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370974    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370976    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370979    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370981    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.378488 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370984    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370986    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370989    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370991    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370994    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370996    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.370998    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371002    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371006    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371009    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371011    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371013    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371016    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371018    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371021    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371023    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371026    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371031    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371036    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.378922 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371039    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371041    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371045    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371048    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371051    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371053    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371056    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371058    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371061    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371064    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371066    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371069    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371071    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371074    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371076    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371079    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371082    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371084    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371087    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371090    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.379397 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371092    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371095    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371098    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371100    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371103    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371106    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371108    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371111    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371113    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371116    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371129    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371133    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371138    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371140    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371144    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371147    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371149    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371152    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371155    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.379867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371157    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371160    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371162    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371165    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371167    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371170    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371173    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371175    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371178    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371181    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371201    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371204    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371206    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371209    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371211    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371214    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.380329 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.371242    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371279    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371283    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371286    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371288    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371291    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371294    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371296    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371300    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371303    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371306    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371309    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371312    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371315    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371319    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371322    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371325    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371327    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371330    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.380692 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371332    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371334    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371337    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371340    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371344    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371347    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371350    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371353    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371356    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371359    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371362    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371365    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371368    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371370    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371373    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371376    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371379    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371381    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371384    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.381150 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371387    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371389    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371393    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371396    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371398    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371402    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371405    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371408    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371410    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371413    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371415    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371418    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371420    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371423    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371425    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371428    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371430    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371433    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371435    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371438    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.381607 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371440    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371442    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371445    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371448    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371450    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371453    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371455    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371458    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371460    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371463    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371465    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371467    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371470    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371472    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371476    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371478    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371481    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371484    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371487    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.382116 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371490    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371492    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371495    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371497    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371500    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371502    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371505    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371507    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371510    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371512    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371515    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371517    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371520    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371523    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371525    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371528    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371530    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371533    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371535    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371538    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.382592 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371540    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371542    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371545    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371549    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371551    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371554    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371556    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371559    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371562    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.371564    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.378365    2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.378381    2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.378397    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.378402    2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378459    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378465    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378469    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378472    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378475    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.383201 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378477    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378480    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378483    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378485    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378488    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378491    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378493    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378496    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378499    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378501    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378504    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378506    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378509    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378511    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378514    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378517    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378519    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378522    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378524    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378526    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.383867 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378529    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378532    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378534    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378537    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378542    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378544    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378547    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378549    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378553    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378556    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378559    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378562    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378565    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378567    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378569    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378572    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378574    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378576    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378579    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.384757 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378582    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378584    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378586    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378589    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378591    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378594    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378596    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378599    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378601    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378605    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378610    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378613    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378616    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378619    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378621    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378624    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378627    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378630    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378633    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.385315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378636    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378639    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378641    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378644    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378646    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378648    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378651    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378653    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378656    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378658    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378661    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378663    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378665    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378668    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378670    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378673    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378675    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378678    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378680    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378683    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.385860 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378685    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378688    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378690    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378693    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378695    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378698    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378700    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378703    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378705    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378708    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378711    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378713    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378717    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378719    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378722    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378724    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378726    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378729    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378731    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.386513 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378734    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378736    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378738    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378741    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.378767    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378907    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378911    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378914    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378917    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378919    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378922    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378924    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378927    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378930    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378932    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378937    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.386978 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378941    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378944    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378946    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378949    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378951    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378954    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378956    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378960    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378963    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.378965    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379343    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379348    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379350    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379353    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379356    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379359    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379361    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379364    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379366    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.387472 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379368    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379371    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379374    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379376    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379378    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379381    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379383    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379386    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379388    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379391    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379395    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379398    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379403    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379407    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379410    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379413    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379415    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379418    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379420    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379423    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.387996 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379426    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379428    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379430    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379433    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379436    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379439    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379441    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379443    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379446    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379448    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379450    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379453    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379455    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379458    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379461    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379463    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379465    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379468    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379470    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379472    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.388750 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379475    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379477    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379480    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379482    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379485    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379487    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379490    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379492    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379495    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379497    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379499    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379503    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379505    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379508    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379510    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379512    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379515    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379518    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379520    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379523    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.389245 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379525    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379528    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379530    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379532    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379535    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379537    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379540    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379542    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379544    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379547    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379549    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379551    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379554    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379556    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379559    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379561    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.389716 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.379586    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379619    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379623    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379626    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379628    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379631    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379633    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379636    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379638    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379641    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379643    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379645    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379648    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379650    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379653    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379656    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379658    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379660    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379663    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379665    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:58.390079 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379668    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379670    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379673    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379675    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379677    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379679    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379682    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379685    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379687    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379690    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379692    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379695    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379698    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379700    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379702    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379705    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379707    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379709    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379712    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379714    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:58.390567 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379717    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379719    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379721    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379724    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379726    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379728    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379731    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379734    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379736    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379739    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379741    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379743    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379745    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379748    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379750    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379752    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379755    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379757    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379759    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:58.391084 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379762    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379764    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379767    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379769    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379772    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379774    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379777    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379780    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379782    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379784    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379787    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379789    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379792    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379794    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379796    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379800    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379803    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379806    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379808    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379811    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:58.391732 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379813    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379816    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379818    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379821    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379823    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379825    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379828    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379830    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379833    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379835    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379838    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379840    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379843    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379845    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379847    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379852    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379855    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379857    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379860    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:58.392352 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379862    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379864    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379867    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379869    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379872    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379875    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379880    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379883    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:43:58.379886    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.379939    2578 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.381810    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.382529    2578 server.go:1014] "Starting client certificate rotation"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.382636    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.382683    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.384789    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:58.392808 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.387296    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:58.398900 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.398881    2578 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:43:58.402572 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.402553    2578 log.go:25] "Validated CRI v1 image API"
Oct 30 21:43:58.403408 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.403383    2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:43:58.407031 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.407012    2578 fs.go:135] Filesystem UUIDs: map[5dbb9917-1937-4366-afbf-19b6bb84a139:/dev/nvme0n1p3 72752232-9ebe-4ae0-a5bd-fab00c74e340:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Oct 30 21:43:58.407031 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.407032    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:43:58.413066 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.412957    2578 manager.go:217] Machine: {Timestamp:2026-10-30 21:43:58.411461089 +0000 UTC m=+0.280864908 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3141347 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24ee5a3a27cb637a39e1cd022310bf SystemUUID:ec24ee5a-3a27-cb63-7a39-e1cd022310bf BootID:3719bd1a-df68-4899-9266-ea3bfa31be50 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:a2:94:af:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:a2:94:af:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:b9:14:9c:e5:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:43:58.413570 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.413560    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:43:58.413702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.413690    2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:43:58.416329 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416304    2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:43:58.416475 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416331    2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-176.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:43:58.416522 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416478    2578 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:43:58.416522 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416487    2578 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:43:58.416573 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416522    2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:58.416573 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.416542    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:58.417167 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.417158    2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:43:58.420531 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.420519    2578 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:43:58.420661 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.420652    2578 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:43:58.421239 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421230    2578 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:43:58.421269 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421245    2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:43:58.421269 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421255    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:43:58.421269 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421264    2578 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:43:58.421369 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421274    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:43:58.421623 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.421610    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:58.424671 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.424655    2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:43:58.429068 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429051    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:58.429731 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429716    2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:43:58.429812 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429758    2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:43:58.429961 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429948    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:43:58.430019 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429970    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:43:58.430019 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429979    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:43:58.430019 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429989    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:43:58.430019 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.429999    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:43:58.430019 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430007    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:43:58.430483 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430473    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:43:58.430530 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430487    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:43:58.430530 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430498    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:43:58.430530 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430508    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:43:58.430530 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430530    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:43:58.430713 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.430544    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:43:58.431478 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.431466    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:43:58.431527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.431483    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:43:58.435213 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.435179    2578 server.go:1263] "Started kubelet"
Oct 30 21:43:58.435325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.435293    2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:43:58.435436 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.435361    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:43:58.435436 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.435433    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:43:58.436041 ip-10-0-130-176 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:43:58.436738 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.436350    2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:43:58.438625 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.438608    2578 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:43:58.443018 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.442993    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:43:58.443402 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.443384    2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:43:58.443810 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.443794    2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:43:58.443924 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.443898    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:43:58.444273 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444255    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:43:58.444273 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444257    2578 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:43:58.444422 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444296    2578 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:43:58.444422 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444383    2578 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:43:58.444422 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444394    2578 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:43:58.444698 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444680    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:43:58.444698 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444697    2578 factory.go:55] Registering systemd factory
Oct 30 21:43:58.444835 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444704    2578 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:43:58.444946 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444930    2578 factory.go:153] Registering CRI-O factory
Oct 30 21:43:58.444986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444951    2578 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:43:58.444986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444984    2578 factory.go:103] Registering Raw factory
Oct 30 21:43:58.445043 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.444999    2578 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:43:58.445853 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.445837    2578 manager.go:319] Starting recovery of all containers
Oct 30 21:43:58.452579 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.452511    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:43:58.456874 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.456857    2578 manager.go:324] Recovery completed
Oct 30 21:43:58.458745 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.458721    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Oct 30 21:43:58.461688 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.461675    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.463463 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.463447    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.463526 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.463485    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.463526 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.463514    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.464090 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464078    2578 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:43:58.464090 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464088    2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:43:58.464231 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464103    2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:43:58.464231 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464148    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.464838 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464822    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.464910 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464849    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.464910 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.464858    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.466346 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.466333    2578 policy_none.go:50] "Start"
Oct 30 21:43:58.466394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.466356    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:43:58.466394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.466370    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:43:58.468346 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.468334    2578 policy_none.go:44] "Start"
Oct 30 21:43:58.507893 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.507745    2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:43:58.512411 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512399    2578 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:43:58.512462 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.512432    2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:43:58.512462 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512445    2578 server.go:87] "Starting device plugin registration server"
Oct 30 21:43:58.512686 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512674    2578 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:43:58.512739 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512690    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:43:58.512784 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512775    2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:43:58.512869 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512854    2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:43:58.512869 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.512867    2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:43:58.513473 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.513448    2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:43:58.513557 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.513512    2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:43:58.584672 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.584651    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:43:58.586823 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.584676    2578 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:43:58.586823 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.584694    2578 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:43:58.586823 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.584726    2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:43:58.613328 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.613284    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.614796 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.614776    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.614888 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.614808    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.614888 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.614822    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.614888 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.614845    2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.636479 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.636460    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-176.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:43:58.636764 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.636741    2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-176.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:43:58.637523 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.636749    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-176.us-west-1.compute.internal.18e36cbda74e8cde  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-176.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-176.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:43:58.43515107 +0000 UTC m=+0.304554889,LastTimestamp:2026-10-30 21:43:58.43515107 +0000 UTC m=+0.304554889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-176.us-west-1.compute.internal,}"
Oct 30 21:43:58.658945 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.658927    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:43:58.659005 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.658977    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sdbmt"
Oct 30 21:43:58.684972 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.684952    2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"]
Oct 30 21:43:58.685023 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.685005    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.685789 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.685775    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.685886 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.685803    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.685886 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.685815    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.687978 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.687967    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.688124 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.688199 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688145    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.688661 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688647    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.688730 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688657    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.688730 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688676    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.688730 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688681    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.688730 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688691    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.688730 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.688694    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.690701 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.690686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.690778 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.690712    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:58.691405 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.691391    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:58.691461 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.691418    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:58.691461 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.691432    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:58.719649 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.719626    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-176.us-west-1.compute.internal\" not found" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.726092 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.726075    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-176.us-west-1.compute.internal\" not found" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.745563 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.745543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.745635 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.745566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.745635 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.745583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.748012 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.747993    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:58.749325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.749303    2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:58.845903 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.845903 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.846127 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.846127 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845984    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.846127 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845984    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.846127 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.845986    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.855128 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.855091    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:58.856517 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.856494    2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:58.856619 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:58.856530    2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-176.us-west-1.compute.internal\": node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:43:58.856735 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.856717    2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:58.944037 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:58.943965    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:59.004366 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.004345    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:59.005270 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.005258    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:59.022665 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.022632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:59.028996 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.028976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:43:59.067943 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.067923    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:59.382830 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.382768    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:43:59.383298 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.382883    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:43:59.383298 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.382883    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:43:59.383298 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.382941    2578 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a9858833090b34fb5b824294711bfe6c-e75a63cf43fa0c23.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-130-176.us-west-1.compute.internal.18e36cbda8ff6889\": read tcp 10.0.130.176:37274->3.149.172.21:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-130-176.us-west-1.compute.internal.18e36cbda8ff6889  default   5408 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-176.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-176.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-176.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:43:58 +0000 UTC,LastTimestamp:2026-10-30 21:43:58.614826268 +0000 UTC m=+0.484230088,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-176.us-west-1.compute.internal,}"
Oct 30 21:43:59.421786 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.421769    2578 apiserver.go:52] "Watching apiserver"
Oct 30 21:43:59.443684 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.443664    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:43:59.663860 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.663749    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:38:59 +0000 UTC" deadline="2028-06-20 06:00:07.423445534 +0000 UTC"
Oct 30 21:43:59.663860 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.663810    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14360h16m7.759641213s"
Oct 30 21:43:59.692525 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.692500    2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:43:59.692860 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.692835    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-527lj","openshift-multus/multus-vghc6","openshift-multus/network-metrics-daemon-rlsms","kube-system/global-pull-secret-syncer-vmc55","openshift-network-operator/iptables-alerter-wjcvf","kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-dd45d","openshift-cluster-node-tuning-operator/tuned-mrmlw","openshift-image-registry/node-ca-gnp7k","openshift-network-diagnostics/network-check-target-hg4h9","openshift-ovn-kubernetes/ovnkube-node-2nx9p","kube-system/konnectivity-agent-zfpxl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"]
Oct 30 21:43:59.695265 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.695245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.697348 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.697327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.699377 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.699362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.699456 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.699425    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:43:59.701410 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.701393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.701494 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.701442    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:43:59.703482 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.703468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.705599 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.705583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.707741 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.707727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.709788 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.709773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.711846 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.711832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.713990 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.713978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.716227 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.716213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:43:59.716280 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.716266    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:43:59.718495 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.718480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.747527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.746127    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:43:59.747527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.747480    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.747527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.747480    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:43:59.747527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.747523    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hfjp\""
Oct 30 21:43:59.747680 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.747555    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.749002 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.748985    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:43:59.749073 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.749039    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:43:59.749073 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.749048    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gmj65\""
Oct 30 21:43:59.751277 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751323 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751323 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfsp\" (UniqueName: \"kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.751323 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.751406 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751406 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.751550 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.751550 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.751550 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.751632 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751632 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751632 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.751632 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.751744 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751744 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751744 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.751744 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751848 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751848 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.751848 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.751848 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.751848 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.751986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.751986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.751986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:43:59.751986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752095 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.751990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752095 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752095 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752095 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.752095 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klbmp\" (UniqueName: \"kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxfp\" (UniqueName: \"kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmn8t\" (UniqueName: \"kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.752464 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vsc4\" (UniqueName: \"kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2jg9\" (UniqueName: \"kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.752681 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrrr\" (UniqueName: \"kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgxzh\" (UniqueName: \"kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.752944 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.752985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.753001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.753019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.753042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.753325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.753066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5c7\" (UniqueName: \"kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.844673 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.844646    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:43:59.844742 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.844701    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z9r4r"
Oct 30 21:43:59.848695 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848615    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.848695 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848635    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.848695 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848635    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848702    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848716    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848725    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848708    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848704    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848764    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:43:59.848873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848702    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.849105 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848878    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:43:59.849105 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848916    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-22kpt\""
Oct 30 21:43:59.849105 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848942    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:43:59.849105 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848946    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.849105 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.848974    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.849277 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849230    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vv2h\""
Oct 30 21:43:59.849277 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849237    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.849277 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849231    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:43:59.849370 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849301    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.849405 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849369    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.849465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849450    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s7wrh\""
Oct 30 21:43:59.849502 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849454    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:59.849537 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.849503    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:43:59.853706 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.853748 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfsp\" (UniqueName: \"kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.853791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.853791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.853791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.853897 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.853897 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.853970 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.853970 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853932    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.853970 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854017    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.853984    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.854117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854120    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854091    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854283    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854293    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854326    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854347    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854357    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.854409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854419    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854331    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854461    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854483    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854486    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854578    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.855156 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854665    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854837    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854853    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klbmp\" (UniqueName: \"kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxfp\" (UniqueName: \"kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.855937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.854982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmn8t\" (UniqueName: \"kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vsc4\" (UniqueName: \"kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2jg9\" (UniqueName: \"kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.856642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855453    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.855543    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855571    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855579    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855596    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855603    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855594    2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.855636    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:00.355583679 +0000 UTC m=+2.224987500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855640    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855684    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855747    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855794    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.857775 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855843    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855895    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855940    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855957    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855964    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.855968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856022    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856026    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856070    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856059    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856095    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856099    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856108    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856122    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.858614 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856146    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856149    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrrr\" (UniqueName: \"kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgxzh\" (UniqueName: \"kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856417    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856438    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856486    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856581    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.859357 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856673    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.856789    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5c7\" (UniqueName: \"kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.856833    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:00.356818338 +0000 UTC m=+2.226222148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856914    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.856938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.857151    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.857317    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.857496    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.858683    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkrw6\""
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.858691    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fqpcl\""
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.858733    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pc99\""
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.859812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.859877 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.859839    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.860508 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.859912    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.860508 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.859996    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:43:59.898498 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.898471    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:43:59.898591 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.898471    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vv25x\""
Oct 30 21:43:59.898664 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.898648    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:43:59.907013 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.906994    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.913242 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.913225    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:59.913242 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.913240    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:59.913369 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.913248    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:59.913369 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:43:59.913324    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:00.413312902 +0000 UTC m=+2.282716725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:59.914864 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.914811    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfsp\" (UniqueName: \"kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:43:59.915951 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.915931    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmn8t\" (UniqueName: \"kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:43:59.916417 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.916396    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxfp\" (UniqueName: \"kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:43:59.919846 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.917128    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrrr\" (UniqueName: \"kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:43:59.919846 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.917252    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2jg9\" (UniqueName: \"kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:43:59.919846 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.917391    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbmp\" (UniqueName: \"kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:43:59.920568 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.920539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgxzh\" (UniqueName: \"kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:43:59.921051 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.921031    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5c7\" (UniqueName: \"kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:43:59.921465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:43:59.921445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vsc4\" (UniqueName: \"kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:44:00.030363 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.030327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:44:00.047414 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.047384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:44:00.063437 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.063416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:44:00.084179 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.084158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:44:00.095886 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.095869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:44:00.112204 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.112172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:44:00.114363 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.114344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vghc6"
Oct 30 21:44:00.129682 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.129661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-527lj"
Oct 30 21:44:00.136280 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.136253    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28179ea_90f6_4da2_a71d_ac889d8795b2.slice/crio-272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0 WatchSource:0}: Error finding container 272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0: Status 404 returned error can't find the container with id 272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0
Oct 30 21:44:00.136672 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.136655    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097b084259da656bcc2cdeca5dda5695.slice/crio-d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9 WatchSource:0}: Error finding container d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9: Status 404 returned error can't find the container with id d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9
Oct 30 21:44:00.137315 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.137293    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff8f2bfa49239d9e2240c708e676d72.slice/crio-0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c WatchSource:0}: Error finding container 0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c: Status 404 returned error can't find the container with id 0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c
Oct 30 21:44:00.138082 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.138065    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd508c5ed_f2c6_4ea0_afb8_18afc8589ae7.slice/crio-32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5 WatchSource:0}: Error finding container 32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5: Status 404 returned error can't find the container with id 32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5
Oct 30 21:44:00.141874 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.141855    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:44:00.142863 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.142847    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53e9c7e_0933_40df_9112_c2422d49300a.slice/crio-822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b WatchSource:0}: Error finding container 822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b: Status 404 returned error can't find the container with id 822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b
Oct 30 21:44:00.148706 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.148690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:00.157735 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:00.157717    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdd0c58_d8d2_44f8_b848_f329c17cff43.slice/crio-f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d WatchSource:0}: Error finding container f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d: Status 404 returned error can't find the container with id f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d
Oct 30 21:44:00.359939 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.359852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:00.359939 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.359928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:00.360147 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.360022    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:00.360147 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.360031    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:00.360147 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.360092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:01.360073799 +0000 UTC m=+3.229477620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:00.360147 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.360109    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:01.360100714 +0000 UTC m=+3.229504534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:00.460962 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.460924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:00.461584 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.461066    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:00.461584 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.461086    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:00.461584 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.461098    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:00.461584 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:00.461160    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:01.461142851 +0000 UTC m=+3.330546674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:00.469097 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:00.469068    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:01.715487 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.715436    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d"}
Oct 30 21:44:01.716515 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.716491    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-527lj" event={"ID":"d53e9c7e-0933-40df-9112-c2422d49300a","Type":"ContainerStarted","Data":"822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b"}
Oct 30 21:44:01.717631 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.717598    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vghc6" event={"ID":"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7","Type":"ContainerStarted","Data":"32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5"}
Oct 30 21:44:01.718622 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.718601    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerStarted","Data":"272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0"}
Oct 30 21:44:01.719570 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.719551    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerStarted","Data":"d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9"}
Oct 30 21:44:01.720538 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.720519    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"7ff8f2bfa49239d9e2240c708e676d72","Type":"ContainerStarted","Data":"0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c"}
Oct 30 21:44:01.974239 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.974139    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:39:00 +0000 UTC" deadline="2028-04-10 22:13:10.51995092 +0000 UTC"
Oct 30 21:44:01.974239 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:01.974182    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12672h29m8.545772409s"
Oct 30 21:44:02.039650 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:02.039619    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30afacbf_8146_41aa_9298_672a74a30f81.slice/crio-e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6 WatchSource:0}: Error finding container e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6: Status 404 returned error can't find the container with id e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6
Oct 30 21:44:02.054985 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:02.054960    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd926117_3d33_4749_bb15_e44f4067a47d.slice/crio-f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044 WatchSource:0}: Error finding container f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044: Status 404 returned error can't find the container with id f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044
Oct 30 21:44:02.063938 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:02.063915    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c422a1f_05d8_4970_b87e_f2d5d5302cc0.slice/crio-4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc WatchSource:0}: Error finding container 4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc: Status 404 returned error can't find the container with id 4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc
Oct 30 21:44:02.065945 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.065873    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:02.143330 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:02.143310    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e22d3ef_c49a_4941_baf7_18af20b42f64.slice/crio-e3a86ee7cc4e2d62595ca8e678ca7f6b583e578abdf9e9a099d627e1f57b6b00 WatchSource:0}: Error finding container e3a86ee7cc4e2d62595ca8e678ca7f6b583e578abdf9e9a099d627e1f57b6b00: Status 404 returned error can't find the container with id e3a86ee7cc4e2d62595ca8e678ca7f6b583e578abdf9e9a099d627e1f57b6b00
Oct 30 21:44:02.181127 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:02.181093    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b898dbb_6ac1_45f8_b6ea_1fae6400f4cc.slice/crio-13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d WatchSource:0}: Error finding container 13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d: Status 404 returned error can't find the container with id 13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d
Oct 30 21:44:02.494411 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.494358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:02.494588 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.494436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:02.494588 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.494564    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:02.494711 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.494619    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:04.49460277 +0000 UTC m=+5.237822978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:02.494711 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.494690    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:02.494823 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.494723    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:04.494712161 +0000 UTC m=+5.237932364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:02.595000 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.594965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:02.595723 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.595125    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:02.595723 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.595140    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:02.595723 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.595149    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:02.595723 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.595189    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:04.595177073 +0000 UTC m=+5.338397275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:02.711740 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.711708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:02.711919 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.711842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:02.711987 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.711928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:02.712040 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.711998    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:02.712098 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.712080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:02.712188 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:02.712158    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:02.724833 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.724796    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mrmlw" event={"ID":"9e22d3ef-c49a-4941-baf7-18af20b42f64","Type":"ContainerStarted","Data":"e3a86ee7cc4e2d62595ca8e678ca7f6b583e578abdf9e9a099d627e1f57b6b00"}
Oct 30 21:44:02.728665 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.728638    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp" event={"ID":"9c422a1f-05d8-4970-b87e-f2d5d5302cc0","Type":"ContainerStarted","Data":"4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc"}
Oct 30 21:44:02.730334 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.730307    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfpxl" event={"ID":"30afacbf-8146-41aa-9298-672a74a30f81","Type":"ContainerStarted","Data":"e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6"}
Oct 30 21:44:02.732554 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.732528    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gnp7k" event={"ID":"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc","Type":"ContainerStarted","Data":"13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d"}
Oct 30 21:44:02.734855 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.734829    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjcvf" event={"ID":"bd926117-3d33-4749-bb15-e44f4067a47d","Type":"ContainerStarted","Data":"f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044"}
Oct 30 21:44:02.975224 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.975124    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:39:00 +0000 UTC" deadline="2028-05-30 16:21:38.174552161 +0000 UTC"
Oct 30 21:44:02.975224 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:02.975186    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13866h37m35.199372524s"
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.513736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.513793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.513919    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.513980    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:08.513963217 +0000 UTC m=+9.257183425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.514355    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:04.514490 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.514426    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:08.514412379 +0000 UTC m=+9.257632573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:04.614740 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.614329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:04.614740 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.614556    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:04.614740 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.614576    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:04.614740 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.614588    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:04.614740 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.614642    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:08.614626018 +0000 UTC m=+9.357846212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:04.711312 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.711283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:04.711475 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.711436    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:04.713469 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.711804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:04.713469 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.711894    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:04.713469 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:04.711946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:04.713469 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:04.712026    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:05.759406 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:05.758761    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="4735789732e1fcb5a7bf9930ce52330385b4592ccb5b3e74698ac8aef97c1ef0" exitCode=0
Oct 30 21:44:05.759406 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:05.759017    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"4735789732e1fcb5a7bf9930ce52330385b4592ccb5b3e74698ac8aef97c1ef0"}
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.711383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:06.711512    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.711594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:06.711671    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.711732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:06.711865 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:06.711824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:06.772642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.771975    2578 generic.go:356] "Generic (PLEG): container finished" podID="097b084259da656bcc2cdeca5dda5695" containerID="efd34bc224b3dc05187f7736ae6c41494b00ec070852997c25ca02b48b8959be" exitCode=0
Oct 30 21:44:06.772642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.772513    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerDied","Data":"efd34bc224b3dc05187f7736ae6c41494b00ec070852997c25ca02b48b8959be"}
Oct 30 21:44:06.779810 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.779783    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"7ff8f2bfa49239d9e2240c708e676d72","Type":"ContainerStarted","Data":"b1c4d6309bc5f97d01829f64313db711113ac4ca342f9c399314afca587d0e48"}
Oct 30 21:44:06.782361 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:06.782333    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfpxl" event={"ID":"30afacbf-8146-41aa-9298-672a74a30f81","Type":"ContainerStarted","Data":"8d2e2fb9d9e60578d039f5e26e5d2c0d9194d1628f04cf883946c02d3c1f6723"}
Oct 30 21:44:07.000688 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:07.000606    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podStartSLOduration=7.000587638 podStartE2EDuration="7.000587638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:06.999958559 +0000 UTC m=+7.743178790" watchObservedRunningTime="2026-10-30 21:44:07.000587638 +0000 UTC m=+7.743807850"
Oct 30 21:44:07.117146 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:07.117089    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfpxl" podStartSLOduration=3.6780255889999998 podStartE2EDuration="8.11706924s" totalImagesPullingTime="4.439043651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:07.116955014 +0000 UTC m=+7.860175236" watchObservedRunningTime="2026-10-30 21:44:07.11706924 +0000 UTC m=+7.860289452"
Oct 30 21:44:07.321682 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:07.321331    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:44:07.322045 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:07.321818    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:44:07.790307 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:07.790269    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerStarted","Data":"cdebd9b5987bfac132a1472a80a37ba222b48d6ee3374ddcaeb5cdef7af2f673"}
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.553502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.553572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.553685    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.553746    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:16.553728205 +0000 UTC m=+17.296948409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.553808    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:08.553885 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.553839    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:16.553829672 +0000 UTC m=+17.297049874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:08.654901 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.654573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:08.654901 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.654753    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:08.654901 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.654770    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:08.654901 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.654780    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:08.654901 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.654828    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:16.654816513 +0000 UTC m=+17.398036719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:08.711711 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.711681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:08.711864 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.711726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:08.711864 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.711825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:08.711972 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.711917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:08.712066 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.712027    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:08.712128 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:08.712102    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:08.794962 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.794924    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp" event={"ID":"9c422a1f-05d8-4970-b87e-f2d5d5302cc0","Type":"ContainerStarted","Data":"43a8c0bcb8700f9c27791feca5ffd3911517aba4c43ad0855c61a4114d8cb70b"}
Oct 30 21:44:08.800528 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.800495    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gnp7k" event={"ID":"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc","Type":"ContainerStarted","Data":"09009ec14a3757dee94ad2038ce4d98fa7296afbd2f63221fdb88acc2b4c2fd3"}
Oct 30 21:44:08.800673 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.800584    2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:44:08.914641 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:08.914547    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" podStartSLOduration=8.914528302 podStartE2EDuration="8.914528302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:07.906051197 +0000 UTC m=+8.649271409" watchObservedRunningTime="2026-10-30 21:44:08.914528302 +0000 UTC m=+9.657748514"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.711128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:10.711211    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.711256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:10.711296    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.711330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:10.712810 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:10.711413    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:10.715531 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.715316    2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:44:10.808596 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.808019    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-527lj" event={"ID":"d53e9c7e-0933-40df-9112-c2422d49300a","Type":"ContainerStarted","Data":"2965c088095bebb4748daebb3fcbca3acd9b5153e7148c8ff085c83110ae1d63"}
Oct 30 21:44:10.810124 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.810096    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vghc6" event={"ID":"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7","Type":"ContainerStarted","Data":"cad7de5aa83018b67fa8f6385d4352bf950656fb6fb3cc604d180178ac7bd2fa"}
Oct 30 21:44:10.812396 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.812352    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp" event={"ID":"9c422a1f-05d8-4970-b87e-f2d5d5302cc0","Type":"ContainerStarted","Data":"38efa9d027dfa1d8ef17b82f93817303ce175b849c4ad0b88192fefd2142b70b"}
Oct 30 21:44:10.814892 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.814867    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerStarted","Data":"7baf2c08583e93e465776bf9b1c680fbebd108e691af4e1baf25f685dc452e1d"}
Oct 30 21:44:10.922911 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:10.922854    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gnp7k" podStartSLOduration=6.409768154 podStartE2EDuration="11.922837793s" totalImagesPullingTime="5.513069639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:08.915514875 +0000 UTC m=+9.658735085" watchObservedRunningTime="2026-10-30 21:44:10.922837793 +0000 UTC m=+11.666058003"
Oct 30 21:44:11.043502 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.043449    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-527lj" podStartSLOduration=3.43233303 podStartE2EDuration="12.043433043s" totalImagesPullingTime="8.611100013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:10.922226328 +0000 UTC m=+11.665446539" watchObservedRunningTime="2026-10-30 21:44:11.043433043 +0000 UTC m=+11.786653268"
Oct 30 21:44:11.160329 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.160223    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-vghc6" podStartSLOduration=3.530165749 podStartE2EDuration="12.16020363s" totalImagesPullingTime="8.630037881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:11.159813482 +0000 UTC m=+11.903033696" watchObservedRunningTime="2026-10-30 21:44:11.16020363 +0000 UTC m=+11.903423844"
Oct 30 21:44:11.644819 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.644634    2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:44:10.715512929Z","UUID":"75fb5073-d0b6-4e40-ae38-db66104f4a4f","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:44:11.647516 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.647078    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:44:11.647516 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.647106    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:44:11.820615 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.820577    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="7baf2c08583e93e465776bf9b1c680fbebd108e691af4e1baf25f685dc452e1d" exitCode=0
Oct 30 21:44:11.821081 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:11.820651    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"7baf2c08583e93e465776bf9b1c680fbebd108e691af4e1baf25f685dc452e1d"}
Oct 30 21:44:12.711924 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.711868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:12.712101 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.711992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:12.712101 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.712014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:12.712200 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:12.712093    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:12.712200 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:12.711996    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:12.712200 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:12.712188    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:12.824020 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.823986    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mrmlw" event={"ID":"9e22d3ef-c49a-4941-baf7-18af20b42f64","Type":"ContainerStarted","Data":"12d7a975c848d5c2ef60b6a7e5c81097c983ffc76d43f69319dde89793a48446"}
Oct 30 21:44:12.826513 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.826488    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp" event={"ID":"9c422a1f-05d8-4970-b87e-f2d5d5302cc0","Type":"ContainerStarted","Data":"c95319d58d194069464637ff237faaf619f12f9d7f9c1eb9bffe7450752575a3"}
Oct 30 21:44:12.827934 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.827904    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjcvf" event={"ID":"bd926117-3d33-4749-bb15-e44f4067a47d","Type":"ContainerStarted","Data":"e92ee7be54e948e74e1aa5f856a60503449bc08017268790f073b5ecbda7ca72"}
Oct 30 21:44:12.940633 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:12.940580    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mrmlw" podStartSLOduration=3.7237431560000003 podStartE2EDuration="13.940567586s" totalImagesPullingTime="10.21682443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:12.94017385 +0000 UTC m=+13.683394062" watchObservedRunningTime="2026-10-30 21:44:12.940567586 +0000 UTC m=+13.683787797"
Oct 30 21:44:13.060394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:13.060294    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp" podStartSLOduration=4.329300664 podStartE2EDuration="14.06028105s" totalImagesPullingTime="9.730980386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:13.060209559 +0000 UTC m=+13.803429769" watchObservedRunningTime="2026-10-30 21:44:13.06028105 +0000 UTC m=+13.803501260"
Oct 30 21:44:13.173664 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:13.173609    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wjcvf" podStartSLOduration=5.639708351 podStartE2EDuration="14.17358961s" totalImagesPullingTime="8.533881259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:13.173417081 +0000 UTC m=+13.916637292" watchObservedRunningTime="2026-10-30 21:44:13.17358961 +0000 UTC m=+13.916809822"
Oct 30 21:44:13.832843 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:13.832808    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="035f752d0e320cb012e586c84c790355341af14c00bf29c2111a2cbda7401ef0" exitCode=0
Oct 30 21:44:13.833440 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:13.832916    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"035f752d0e320cb012e586c84c790355341af14c00bf29c2111a2cbda7401ef0"}
Oct 30 21:44:14.711392 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:14.711325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:14.711568 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:14.711475    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:14.711568 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:14.711551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:14.711682 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:14.711607    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:14.711682 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:14.711652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:14.711777 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:14.711702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:15.839812 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:15.839572    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="ed43b72f5d596c93f37d393d7852bac9ceed8a77dd2f9418d1115a236dcb0fe0" exitCode=0
Oct 30 21:44:15.839812 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:15.839680    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"ed43b72f5d596c93f37d393d7852bac9ceed8a77dd2f9418d1115a236dcb0fe0"}
Oct 30 21:44:16.618100 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.618073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:16.618283 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.618109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:16.618283 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.618212    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:16.618283 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.618218    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:16.618283 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.618264    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:32.618251667 +0000 UTC m=+33.361471869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:16.618283 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.618278    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:44:32.618270909 +0000 UTC m=+33.361491098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:16.711068 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.711043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:16.711166 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.711150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:16.711239 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.711155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:16.711280 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.711252    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:16.711280 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.711153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:16.711345 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.711279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:16.719338 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.719315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:16.719489 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.719474    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:16.719528 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.719498    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:16.719528 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.719507    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:16.719650 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:16.719547    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:32.719533405 +0000 UTC m=+33.462753594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:16.844325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.844299    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:44:16.844896 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.844868    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerDied","Data":"0f2138e96cddf685e3fdf1bf1059c7e3261b7237ba412f58d1304871c86f7a57"}
Oct 30 21:44:16.845749 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.844769    2578 generic.go:356] "Generic (PLEG): container finished" podID="4bdd0c58-d8d2-44f8-b848-f329c17cff43" containerID="0f2138e96cddf685e3fdf1bf1059c7e3261b7237ba412f58d1304871c86f7a57" exitCode=1
Oct 30 21:44:16.845851 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:16.845774    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"fe61aee335fbdfe0f6d3acc9fb4842381c2b3c1e2a0a5825e2ef1570d62ee0bc"}
Oct 30 21:44:17.850820 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:17.850653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:44:17.851226 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:17.851146    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"5f6afd1cf5e01ccf540b0b9d6af1fe9b6d27e9016aa536e931fa332405767979"}
Oct 30 21:44:17.851226 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:17.851216    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"21ac3833a7a52fc2ec905e9c98717afe68b4e68c007fe4da847dbaf6bc9e7736"}
Oct 30 21:44:17.851290 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:17.851248    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"c0e8cd7305c6cda547a974a73a3941865d4ea3e92b80848d86b5b14f317fd756"}
Oct 30 21:44:17.851290 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:17.851284    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"6ff6f6766a8fd0787f1d2710842cc9bd681f1889c242d73d3067aec614a104fa"}
Oct 30 21:44:18.711459 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:18.711428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:18.711616 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:18.711465    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:18.711616 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:18.711437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:18.711616 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:18.711545    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:18.711776 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:18.711621    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:18.711776 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:18.711689    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:18.855843 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:18.855800    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="c3dbc4d7ee7d4cc012247599b73c529feba8a52e87483870065627cf011c2f40" exitCode=0
Oct 30 21:44:18.856269 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:18.855845    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"c3dbc4d7ee7d4cc012247599b73c529feba8a52e87483870065627cf011c2f40"}
Oct 30 21:44:19.860490 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:19.860461    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:44:19.860949 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:19.860876    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"49c5eac0519b60f71d2fa05eba0b1feeb56b8a3193be4981c8f6b6d94df47f32"}
Oct 30 21:44:19.863670 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:19.863644    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="7050ea9e68ff39a3f77f869ac31d14415462928722aa66624b672b60b08cf602" exitCode=0
Oct 30 21:44:19.863771 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:19.863680    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerDied","Data":"7050ea9e68ff39a3f77f869ac31d14415462928722aa66624b672b60b08cf602"}
Oct 30 21:44:20.711244 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:20.711214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:20.711431 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:20.711266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:20.711431 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:20.711292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:20.711431 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:20.711346    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:20.711530 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:20.711470    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:20.711566 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:20.711539    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:20.869561 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:20.869526    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dd45d" event={"ID":"f28179ea-90f6-4da2-a71d-ac889d8795b2","Type":"ContainerStarted","Data":"f6948e6a1ed39e6ad683165bff105750be18ae73e483162769eb0826eac21792"}
Oct 30 21:44:20.992195 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:20.992070    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dd45d" podStartSLOduration=9.106612386 podStartE2EDuration="21.992057094s" totalImagesPullingTime="12.885444708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:20.992026538 +0000 UTC m=+21.735246750" watchObservedRunningTime="2026-10-30 21:44:20.992057094 +0000 UTC m=+21.735277302"
Oct 30 21:44:21.875762 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:21.875592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:44:21.876333 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:21.876143    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"b038dc1163b74e05abaeb624d624a0d1b56d2d65216c40a956fc3f8d1dad3d71"}
Oct 30 21:44:21.876709 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:21.876689    2578 scope.go:122] "RemoveContainer" containerID="0f2138e96cddf685e3fdf1bf1059c7e3261b7237ba412f58d1304871c86f7a57"
Oct 30 21:44:22.711219 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.711181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:22.711582 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.711235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:22.711582 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.711345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:22.711582 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:22.711393    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:22.711582 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:22.711460    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:22.711582 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:22.711511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:22.882271 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.882243    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:44:22.882736 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.882587    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" event={"ID":"4bdd0c58-d8d2-44f8-b848-f329c17cff43","Type":"ContainerStarted","Data":"5bae5adf44cc622a51bfb7f5caa1f3e6f2db097ed4e55d314b6eb8107320c579"}
Oct 30 21:44:22.882982 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.882958    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:22.883117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.883031    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:22.883117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.883079    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:22.897914 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.897889    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:22.898050 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:22.897991    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:23.162268 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:23.162149    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p" podStartSLOduration=8.827120928 podStartE2EDuration="24.162133161s" totalImagesPullingTime="15.335012233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:23.134940722 +0000 UTC m=+23.878160933" watchObservedRunningTime="2026-10-30 21:44:23.162133161 +0000 UTC m=+23.905353372"
Oct 30 21:44:24.711238 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:24.711190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:24.711238 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:24.711228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:24.711728 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:24.711319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:24.711728 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:24.711326    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:24.711728 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:24.711407    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:24.711728 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:24.711493    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:25.666274 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:25.666246    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:44:25.666473 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:25.666412    2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:44:25.666781 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:25.666760    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:44:26.711836 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:26.711797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:26.711836 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:26.711838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:26.712289 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:26.711901    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:26.712289 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:26.711947    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:26.712289 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:26.712000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:26.712289 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:26.712062    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:26.774754 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:26.774730    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-527lj_d53e9c7e-0933-40df-9112-c2422d49300a/dns-node-resolver/0.log"
Oct 30 21:44:27.873822 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:27.873792    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gnp7k_8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc/node-ca/0.log"
Oct 30 21:44:28.711790 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:28.711716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:28.711937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:28.711806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:28.711937 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:28.711812    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:28.711937 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:28.711885    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:28.711937 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:28.711903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:28.712070 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:28.711979    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:30.711606 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:30.711575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:30.711966 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:30.711651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:30.711966 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:30.711678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:30.711966 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:30.711770    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:30.711966 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:30.711808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:30.711966 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:30.711901    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:32.632496 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.632463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:32.632496 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.632504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:32.632996 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.632602    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:32.632996 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.632616    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:32.632996 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.632655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret podName:cfa25fa1-62fb-44e6-a0de-1b885cea1c73 nodeName:}" failed. No retries permitted until 2026-10-30 21:45:04.632642552 +0000 UTC m=+65.375862741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret") pod "global-pull-secret-syncer-vmc55" (UID: "cfa25fa1-62fb-44e6-a0de-1b885cea1c73") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:44:32.632996 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.632669    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs podName:50a0b339-36a2-46de-a121-7399125b6d6f nodeName:}" failed. No retries permitted until 2026-10-30 21:45:04.632663477 +0000 UTC m=+65.375883666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs") pod "network-metrics-daemon-rlsms" (UID: "50a0b339-36a2-46de-a121-7399125b6d6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:44:32.711629 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.711604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:32.711804 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.711663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:32.711804 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.711740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:32.711804 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.711755    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:32.711953 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.711812    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:32.712010 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.711978    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:32.733840 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:32.733810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:32.733960 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.733933    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:44:32.733960 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.733946    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:44:32.733960 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.733954    2578 projected.go:196] Error preparing data for projected volume kube-api-access-t7g76 for pod openshift-network-diagnostics/network-check-target-hg4h9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:32.734057 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:32.734003    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76 podName:06b42278-c848-4e19-8312-e235b5027b97 nodeName:}" failed. No retries permitted until 2026-10-30 21:45:04.73398725 +0000 UTC m=+65.477207456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7g76" (UniqueName: "kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76") pod "network-check-target-hg4h9" (UID: "06b42278-c848-4e19-8312-e235b5027b97") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:44:34.711212 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:34.711181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:34.711736 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:34.711283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:34.711736 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:34.711298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:34.711736 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:34.711384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:34.711736 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:34.711391    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:34.711736 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:34.711460    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:36.711662 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:36.711622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:36.712098 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:36.711713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:36.712098 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:36.711721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:36.712098 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:36.711726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:36.712098 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:36.711786    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:36.712098 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:36.711857    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:38.711565 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:38.711529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:38.712084 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:38.711600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:38.712084 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:38.711700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:38.712084 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:38.711702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:38.712084 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:38.711756    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:38.712084 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:38.711823    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:40.711945 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:40.711907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:40.712326 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:40.711953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:40.712326 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:40.712030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:40.712326 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:40.712042    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:40.712326 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:40.712115    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:40.712326 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:40.712197    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:42.711840 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:42.711816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:42.714214 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:42.712304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:42.714214 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:42.712891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:42.714214 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:42.713918    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:42.714214 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:42.714035    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:42.714214 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:42.713436    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:43.054235 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.054038    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg4h9"]
Oct 30 21:44:43.054340 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.054316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:43.054455 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:43.054434    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:43.058024 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.057996    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmc55"]
Oct 30 21:44:43.058151 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.058103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:43.058219 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.058161    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlsms"]
Oct 30 21:44:43.058219 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:43.058206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:43.058328 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:43.058250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:43.058403 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:43.058348    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:44.711426 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:44.711395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:44.711817 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:44.711458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:44.711817 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:44.711481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:44.711817 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:44.711562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:44.711817 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:44.711602    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:44.711817 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:44.711680    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:46.711445 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:46.711406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:46.712046 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:46.711458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:46.712046 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:46.711578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:46.712046 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:46.711599    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmc55" podUID="cfa25fa1-62fb-44e6-a0de-1b885cea1c73"
Oct 30 21:44:46.712046 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:46.711676    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg4h9" podUID="06b42278-c848-4e19-8312-e235b5027b97"
Oct 30 21:44:46.712046 ip-10-0-130-176 kubenswrapper[2578]: E1030 21:44:46.711763    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlsms" podUID="50a0b339-36a2-46de-a121-7399125b6d6f"
Oct 30 21:44:47.953215 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:47.953146    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:44:47.953596 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:47.953270    2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:44:48.109794 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.109756    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f2864"]
Oct 30 21:44:48.111454 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.111437    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f4m64"]
Oct 30 21:44:48.111596 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.111579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.113179 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.113160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.155588 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.155555    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-64t9j"]
Oct 30 21:44:48.157971 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.157946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.163875 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.163791    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:44:48.164063 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.164041    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjn2k\""
Oct 30 21:44:48.164173 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.164087    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:44:48.165028 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.165007    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ltjsw\""
Oct 30 21:44:48.165028 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.165029    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:44:48.165258 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.165243    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:44:48.169439 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.169420    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:44:48.169531 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.169488    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:44:48.182190 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.182142    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2864"]
Oct 30 21:44:48.204515 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.204426    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f4m64"]
Oct 30 21:44:48.220070 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.220036    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64t9j"]
Oct 30 21:44:48.238840 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.238789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcs7\" (UniqueName: \"kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.238840 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.238841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4z2\" (UniqueName: \"kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.239140 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.238929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.239140 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.238970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.239140 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.239027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.239140 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.239062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.239140 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.239083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.239423 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.239211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.239423 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.239311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.264576 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.264539    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:44:48.264576 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.264568    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vzpnp\""
Oct 30 21:44:48.264576 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.264571    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:44:48.264789 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.264539    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:44:48.340394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.340593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.340593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcs7\" (UniqueName: \"kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.340593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.340593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4z2\" (UniqueName: \"kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.340593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tqmf\" (UniqueName: \"kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.340826 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.340643    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.341092 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.341026    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.341092 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.341053    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.341329 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.341302    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.341329 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.341303    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.345344 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.345306    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.345344 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.345327    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.402461 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.402430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcs7\" (UniqueName: \"kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.402917 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.402892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4z2\" (UniqueName: \"kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.424922 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.424871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:48.430611 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.430586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:44:48.441286 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.441247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.441408 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.441343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tqmf\" (UniqueName: \"kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.443935 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.443900    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.502628 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.502588    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tqmf\" (UniqueName: \"kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.711941 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.711899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:44:48.712119 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.711957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:44:48.712119 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.711975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:44:48.764928 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.764847    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:44:48.764928 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.764875    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:44:48.765096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.765048    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:44:48.765096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.765066    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ph4bx\""
Oct 30 21:44:48.765096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.765076    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:44:48.765096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.765066    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2rr9\""
Oct 30 21:44:48.765096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.765091    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6ptf6\""
Oct 30 21:44:48.768109 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.768097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:44:48.812533 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.812400    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f4m64"]
Oct 30 21:44:48.860742 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.860717    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2864"]
Oct 30 21:44:48.863320 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:48.863299    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a62217_094a_4702_a1c1_f549178905ee.slice/crio-a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4 WatchSource:0}: Error finding container a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4: Status 404 returned error can't find the container with id a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4
Oct 30 21:44:48.939047 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.939015    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f4m64" event={"ID":"081df627-1a6c-47d6-b63b-64ee0d0fbef8","Type":"ContainerStarted","Data":"27eff1589419913fbdba35f984f2bc26e50d6d9a588f84e3da363a1a9348f0ce"}
Oct 30 21:44:48.939197 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.939074    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f4m64" event={"ID":"081df627-1a6c-47d6-b63b-64ee0d0fbef8","Type":"ContainerStarted","Data":"52954b4df8262e32c4b13c0206de7e1e1e68831da6ad588529530fbcd5a29c6c"}
Oct 30 21:44:48.940045 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:48.940028    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2864" event={"ID":"b3a62217-094a-4702-a1c1-f549178905ee","Type":"ContainerStarted","Data":"a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4"}
Oct 30 21:44:49.136193 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.136118    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64t9j"]
Oct 30 21:44:49.139522 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:49.139493    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ca3ec5_c805_4cf1_865a_eb0e1b337403.slice/crio-f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d WatchSource:0}: Error finding container f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d: Status 404 returned error can't find the container with id f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d
Oct 30 21:44:49.753124 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.752974    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"]
Oct 30 21:44:49.754860 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.754846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.806983 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.806957    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:44:49.807104 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.806998    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:44:49.807104 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.807100    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:44:49.807192 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.807158    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 21:44:49.818537 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.818510    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vwmgd\""
Oct 30 21:44:49.818537 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.818517    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 21:44:49.819914 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.819896    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"]
Oct 30 21:44:49.850811 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.850787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.850941 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.850824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q24j\" (UniqueName: \"kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.851012 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.850968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.851074 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.851060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.944272 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.944230    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64t9j" event={"ID":"a7ca3ec5-c805-4cf1-865a-eb0e1b337403","Type":"ContainerStarted","Data":"f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d"}
Oct 30 21:44:49.951687 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.951655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.951868 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.951727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.951868 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.951764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.951868 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.951789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q24j\" (UniqueName: \"kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.952868 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.952840    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.956791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.956764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:49.956929 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:49.956908    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:50.013914 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:50.013882    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q24j\" (UniqueName: \"kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:50.065092 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:50.065072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:44:50.440421 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:50.440322    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"]
Oct 30 21:44:50.444396 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:50.444248    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904e4f55_1d16_4919_b398_15506d1c2e7c.slice/crio-8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44 WatchSource:0}: Error finding container 8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44: Status 404 returned error can't find the container with id 8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44
Oct 30 21:44:50.950038 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:50.949994    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f4m64" event={"ID":"081df627-1a6c-47d6-b63b-64ee0d0fbef8","Type":"ContainerStarted","Data":"b926b991fc5f809a9993e14d1b259c1d55bfb4b720089974e908271584827d4f"}
Oct 30 21:44:50.951542 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:50.951514    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t" event={"ID":"904e4f55-1d16-4919-b398-15506d1c2e7c","Type":"ContainerStarted","Data":"8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44"}
Oct 30 21:44:51.958183 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:51.958137    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2864" event={"ID":"b3a62217-094a-4702-a1c1-f549178905ee","Type":"ContainerStarted","Data":"de39830965a1d3f9ee5137751f847af2d7d97188f13ebd6191f725ebca6c1ebc"}
Oct 30 21:44:51.958647 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:51.958257    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2864" event={"ID":"b3a62217-094a-4702-a1c1-f549178905ee","Type":"ContainerStarted","Data":"581fb1e5fb8d45a9bed30eb623ee456938b019287046c59a005940c27cc64aa0"}
Oct 30 21:44:51.958647 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:51.958509    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f2864"
Oct 30 21:44:52.078209 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:52.078153    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-f2864" podStartSLOduration=1.724642638 podStartE2EDuration="4.078138513s" totalImagesPullingTime="2.353495875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:52.076747515 +0000 UTC m=+52.819967749" watchObservedRunningTime="2026-10-30 21:44:52.078138513 +0000 UTC m=+52.821358725"
Oct 30 21:44:52.963417 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:52.963358    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f4m64" event={"ID":"081df627-1a6c-47d6-b63b-64ee0d0fbef8","Type":"ContainerStarted","Data":"eb12885d7e2d9feda43633d52d82d08d03016594a01718cb651d5cb2be8a0733"}
Oct 30 21:44:52.965171 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:52.965145    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t" event={"ID":"904e4f55-1d16-4919-b398-15506d1c2e7c","Type":"ContainerStarted","Data":"bd5d1d99cd4d117d6bea55b18aa1a0b3ea2910d7f5d646bf19426d9b9e1fb3a3"}
Oct 30 21:44:52.965288 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:52.965193    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t" event={"ID":"904e4f55-1d16-4919-b398-15506d1c2e7c","Type":"ContainerStarted","Data":"eed5d0e0161e4e1d98c34ccbe49489d12a4454323b5446c0c3cd6cdf71c226f5"}
Oct 30 21:44:52.966621 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:52.966593    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64t9j" event={"ID":"a7ca3ec5-c805-4cf1-865a-eb0e1b337403","Type":"ContainerStarted","Data":"3e6717ab2770916e165f35a0fdf8d143e81936bfb4a5cab5e8b2d9e741afb2ae"}
Oct 30 21:44:53.086138 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:53.086091    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f4m64" podStartSLOduration=1.8728679160000001 podStartE2EDuration="5.086077421s" totalImagesPullingTime="3.213209505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:53.085419964 +0000 UTC m=+53.828640200" watchObservedRunningTime="2026-10-30 21:44:53.086077421 +0000 UTC m=+53.829297643"
Oct 30 21:44:53.204948 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:53.204903    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-64t9j" podStartSLOduration=1.6247387290000002 podStartE2EDuration="5.204889777s" totalImagesPullingTime="3.580151048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:53.204019145 +0000 UTC m=+53.947239377" watchObservedRunningTime="2026-10-30 21:44:53.204889777 +0000 UTC m=+53.948109987"
Oct 30 21:44:53.322332 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:53.322237    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t" podStartSLOduration=2.464327485 podStartE2EDuration="4.322223736s" totalImagesPullingTime="1.857896251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:53.3216794 +0000 UTC m=+54.064899637" watchObservedRunningTime="2026-10-30 21:44:53.322223736 +0000 UTC m=+54.065443947"
Oct 30 21:44:54.904403 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:54.902205    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:44:56.212494 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.212460    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"]
Oct 30 21:44:56.214592 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.214572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.266904 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.266880    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 21:44:56.266904 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.266882    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lddw4\""
Oct 30 21:44:56.266904 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.266882    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:44:56.306783 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.306757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.306916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.306816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.306967 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.306922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.307020 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.306975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zllr4\" (UniqueName: \"kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.317547 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.317522    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"]
Oct 30 21:44:56.367577 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.367545    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"]
Oct 30 21:44:56.369529 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.369509    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p9fg6"]
Oct 30 21:44:56.369652 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.369636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.371364 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.371342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407548 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.407678 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407678 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407678 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.407678 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407814 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407814 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.407814 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.407916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.407916 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mzw\" (UniqueName: \"kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.408016 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.407984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.408016 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.408102 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.408102 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.408102 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.408231 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwsz\" (UniqueName: \"kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.408324 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllr4\" (UniqueName: \"kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.408394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.408718 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.408695    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.410113 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.410094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.410609 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.410592    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.421777 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.421755    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 21:44:56.421777 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.421755    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:44:56.421923 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.421847    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h672v\""
Oct 30 21:44:56.423470 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.423458    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:44:56.423544 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.423471    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:44:56.423544 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.423476    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7g595\""
Oct 30 21:44:56.429630 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.429613    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"]
Oct 30 21:44:56.469629 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.469602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllr4\" (UniqueName: \"kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.509218 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509395 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509364    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mzw\" (UniqueName: \"kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwsz\" (UniqueName: \"kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.509702 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.510287 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509861    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.510287 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509908    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.510287 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509982    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.510287 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.509994    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.510287 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.510191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.510650 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.510627    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.511418 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.511356    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:44:56.511527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.511443    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 21:44:56.512212 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.511911    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.512289 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.512230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.512472 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.512456    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.512519 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.512475    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.520735 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.520712    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.520829 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.520813    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.525634 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.525617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:44:56.573863 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.573670    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mzw\" (UniqueName: \"kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.573863 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.573713    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwsz\" (UniqueName: \"kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.682659 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.682622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:44:56.687018 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.687004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:44:56.695776 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:56.695750    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63792577_37e5_4fd1_9398_a3901b22b391.slice/crio-06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199 WatchSource:0}: Error finding container 06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199: Status 404 returned error can't find the container with id 06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199
Oct 30 21:44:56.945023 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.944990    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"]
Oct 30 21:44:56.947584 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:56.947553    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c28eb9_feb7_44f1_ae79_32a241449056.slice/crio-808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271 WatchSource:0}: Error finding container 808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271: Status 404 returned error can't find the container with id 808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271
Oct 30 21:44:56.980736 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.980668    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9fg6" event={"ID":"63792577-37e5-4fd1-9398-a3901b22b391","Type":"ContainerStarted","Data":"06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199"}
Oct 30 21:44:56.981971 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:56.981934    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5" event={"ID":"07c28eb9-feb7-44f1-ae79-32a241449056","Type":"ContainerStarted","Data":"808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271"}
Oct 30 21:44:57.058473 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:57.058452    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"]
Oct 30 21:44:57.061134 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:57.061113    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497b8e7d_4ec6_4aa0_bcb5_588889dff64b.slice/crio-a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0 WatchSource:0}: Error finding container a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0: Status 404 returned error can't find the container with id a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0
Oct 30 21:44:57.988001 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:57.987966    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5" event={"ID":"07c28eb9-feb7-44f1-ae79-32a241449056","Type":"ContainerStarted","Data":"230c6ccd8b5a09b456a51283dabb9b2a7263780ada9ecb2138913503165bd6e4"}
Oct 30 21:44:57.988508 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:57.988030    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5" event={"ID":"07c28eb9-feb7-44f1-ae79-32a241449056","Type":"ContainerStarted","Data":"2eb0e1cd85f7cc3a1579913e5a60a3f38e37fa925c177d917eb57bd37426bc89"}
Oct 30 21:44:57.989512 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:57.989486    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n" event={"ID":"497b8e7d-4ec6-4aa0-bcb5-588889dff64b","Type":"ContainerStarted","Data":"a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0"}
Oct 30 21:44:58.616519 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.616479    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:44:58.619514 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.619491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.625703 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.625703 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.625703 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.625703 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.625703 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626029 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.625954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626262 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.626113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.626262 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.626151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.691236 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691205    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 21:44:58.691465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691302    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 21:44:58.691465 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691321    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 21:44:58.691638 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691621    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 21:44:58.691696 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691623    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 21:44:58.691696 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691652    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 21:44:58.691696 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.691654    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hcpdk\""
Oct 30 21:44:58.726873 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.726850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.726947 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.726892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.726947 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.726918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727049 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.726945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727049 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.726975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727049 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727403 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727403 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.727403 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.727280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.728998 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.728843    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.728998 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.728971    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.730400 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.730343    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.730894 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.730872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.730967 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.730884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.731450 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.731403    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.731791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.731772    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.732084 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.732040    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.732968 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.732950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.790040 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.789999    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 21:44:58.791261 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.791239    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:44:58.791571 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.791264    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 21:44:58.791571 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.791279    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 21:44:58.799298 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.799242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.800133 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.800088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.804423 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.803124    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.811402 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.811357    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.942489 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.942464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:44:58.984158 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.982261    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"]
Oct 30 21:44:58.985404 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:58.985332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.007642 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.007321    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5" event={"ID":"07c28eb9-feb7-44f1-ae79-32a241449056","Type":"ContainerStarted","Data":"f7b9465b544ea2e54478f7a9376abacca5f7a7a01a30590135f46833bd39e8ea"}
Oct 30 21:44:59.013851 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.013818    2578 generic.go:356] "Generic (PLEG): container finished" podID="63792577-37e5-4fd1-9398-a3901b22b391" containerID="9e7dbad3ba9bd2c85c52aade07ce1acb62ca09a3f51cf23be00502dfc6c163ec" exitCode=0
Oct 30 21:44:59.014792 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.013904    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9fg6" event={"ID":"63792577-37e5-4fd1-9398-a3901b22b391","Type":"ContainerDied","Data":"9e7dbad3ba9bd2c85c52aade07ce1acb62ca09a3f51cf23be00502dfc6c163ec"}
Oct 30 21:44:59.018611 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.018577    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n" event={"ID":"497b8e7d-4ec6-4aa0-bcb5-588889dff64b","Type":"ContainerStarted","Data":"c4c47949440bac65bfc08e5b3fcf8f07454102f9d7ed6a3ae8b07fd11fa06eb4"}
Oct 30 21:44:59.018779 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.018761    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n" event={"ID":"497b8e7d-4ec6-4aa0-bcb5-588889dff64b","Type":"ContainerStarted","Data":"e3033daac3f99ae5330ee6607a73697e7540cd1919575e9908946255318e7d30"}
Oct 30 21:44:59.018885 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.018871    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n" event={"ID":"497b8e7d-4ec6-4aa0-bcb5-588889dff64b","Type":"ContainerStarted","Data":"a13508a29b242a735ee8bf4689059a2fb3fac424b8ebddfb5eaebc3737e30d5d"}
Oct 30 21:44:59.029286 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029423 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029485 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxx6b\" (UniqueName: \"kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029550 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029639 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029847 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.029924 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.029903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.030100 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.030081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.030174 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.030147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.039401 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039357    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 21:44:59.039401 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039396    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 21:44:59.039527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039418    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 21:44:59.039527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039357    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 21:44:59.039527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039456    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tqhcl\""
Oct 30 21:44:59.039527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039460    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 21:44:59.039527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.039509    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5001o2490p8s5\""
Oct 30 21:44:59.050683 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.050660    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"]
Oct 30 21:44:59.131262 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131353 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131353 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131353 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxx6b\" (UniqueName: \"kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131855 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.131855 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.131762    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.132259 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.132235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.134253 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.134231    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.134769 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.134733    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.134911 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.134892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.134960 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.134892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.134991 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.134979    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.135876 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.135862    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.192591 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.192557    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxx6b\" (UniqueName: \"kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.226744 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.226685    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n" podStartSLOduration=1.488977422 podStartE2EDuration="3.226671546s" totalImagesPullingTime="1.737694124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:59.225979758 +0000 UTC m=+59.969199969" watchObservedRunningTime="2026-10-30 21:44:59.226671546 +0000 UTC m=+59.969891756"
Oct 30 21:44:59.314093 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.314062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:44:59.345791 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.345737    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5" podStartSLOduration=1.687904916 podStartE2EDuration="3.345718925s" totalImagesPullingTime="1.657814009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:59.344607893 +0000 UTC m=+60.087828104" watchObservedRunningTime="2026-10-30 21:44:59.345718925 +0000 UTC m=+60.088939135"
Oct 30 21:44:59.386532 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.386504    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:44:59.693005 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:44:59.692933    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"]
Oct 30 21:44:59.695915 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:44:59.695892    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91247e1_6c15_4eb3_909c_4145e59ec71a.slice/crio-d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957 WatchSource:0}: Error finding container d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957: Status 404 returned error can't find the container with id d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957
Oct 30 21:45:00.024318 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:00.024286    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9fg6" event={"ID":"63792577-37e5-4fd1-9398-a3901b22b391","Type":"ContainerStarted","Data":"a42aa8d56593e6bc79eac51a78c3b6dd86678cb2a8c6ea0489a063fe227e9997"}
Oct 30 21:45:00.024799 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:00.024341    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9fg6" event={"ID":"63792577-37e5-4fd1-9398-a3901b22b391","Type":"ContainerStarted","Data":"3f4a3081e0260479a3556a96effdb9008197ee1f566ae9ba34543ec0115869be"}
Oct 30 21:45:00.025577 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:00.025557    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"f0e0d00b8f4a6d39d14d124472b4e77a00ce0e5870e1af200beaf831ac306a12"}
Oct 30 21:45:00.026711 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:00.026690    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957"}
Oct 30 21:45:00.144805 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:00.144756    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p9fg6" podStartSLOduration=2.706225856 podStartE2EDuration="4.14474078s" totalImagesPullingTime="1.353291007s" totalInitContainerRuntime="85.223917ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:00.143441228 +0000 UTC m=+60.886661497" watchObservedRunningTime="2026-10-30 21:45:00.14474078 +0000 UTC m=+60.887961027"
Oct 30 21:45:01.030050 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.030019    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"]
Oct 30 21:45:01.032233 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.032209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.033338 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.032572    2578 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="be7b7be2a671f16fd197a104d68b95ce92ba965307867a7fde6b06f43ef4bb7e" exitCode=0
Oct 30 21:45:01.033338 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.032630    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"be7b7be2a671f16fd197a104d68b95ce92ba965307867a7fde6b06f43ef4bb7e"}
Oct 30 21:45:01.055891 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.055862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pjrc\" (UniqueName: \"kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.056090 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.055945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.092828 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.092795    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"]
Oct 30 21:45:01.113098 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.113027    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 21:45:01.113098 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.113066    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jxsgm\""
Oct 30 21:45:01.157419 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.157355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pjrc\" (UniqueName: \"kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.157618 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.157448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.160519 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.160492    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.221160 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.221119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pjrc\" (UniqueName: \"kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.282663 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.282630    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"]
Oct 30 21:45:01.285271 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.285248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.340171 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340138    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:45:01.340319 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340208    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 21:45:01.340319 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340269    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 21:45:01.340453 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340399    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 21:45:01.340499 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340455    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8t5hsba9p2lg0\""
Oct 30 21:45:01.340557 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.340543    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n4tdx\""
Oct 30 21:45:01.349023 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.348993    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"]
Oct 30 21:45:01.353659 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.353637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:01.358883 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.358856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359041 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.358902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.359042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359117 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.359080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359216 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.359190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359271 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.359234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67jsq\" (UniqueName: \"kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.359325 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.359297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460005 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.459963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67jsq\" (UniqueName: \"kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460324 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460324 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.460980 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.460953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.461409 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.461353    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.461612 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.461586    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.462975 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.462953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.463061 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.463014    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.463149 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.463133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.522096 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.522062    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67jsq\" (UniqueName: \"kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.600387 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.600336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:01.722034 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.722011    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"]
Oct 30 21:45:01.725140 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:01.725104    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa5ed76_7b28_4719_a111_512d990b5e70.slice/crio-c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d WatchSource:0}: Error finding container c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d: Status 404 returned error can't find the container with id c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d
Oct 30 21:45:01.969035 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.969007    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:01.979621 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:01.979333    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"]
Oct 30 21:45:01.982011 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:01.981982    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c55ef5_2a2d_4ea9_9c45_dada2d2ad3ed.slice/crio-3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f WatchSource:0}: Error finding container 3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f: Status 404 returned error can't find the container with id 3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f
Oct 30 21:45:02.027538 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.027511    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-679f8f864b-9b6s6"]
Oct 30 21:45:02.030475 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.030453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.038913 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.038774    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb" event={"ID":"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed","Type":"ContainerStarted","Data":"3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f"}
Oct 30 21:45:02.040901 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.040393    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b" event={"ID":"8aa5ed76-7b28-4719-a111-512d990b5e70","Type":"ContainerStarted","Data":"c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d"}
Oct 30 21:45:02.066593 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066762 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066818 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066867 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhbc\" (UniqueName: \"kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066867 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066945 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.066945 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.067006 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.066943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.083108 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.083073    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 21:45:02.083302 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.083194    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 21:45:02.083302 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.083226    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 21:45:02.083302 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.083269    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 21:45:02.083607 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.083585    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gf2b7\""
Oct 30 21:45:02.084364 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.084338    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 21:45:02.139394 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.135860    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 21:45:02.139925 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.139903    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-679f8f864b-9b6s6"]
Oct 30 21:45:02.167816 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.167773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.167993 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.167828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.167993 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.167875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.167993 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.167955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.168097 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.168013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.168097 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.168038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhbc\" (UniqueName: \"kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.168097 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.168067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.168196 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.168141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.168915 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.168860    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.169518 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.169493    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.171022 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.170966    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.193559 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.178908    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.193559 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.179291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.193559 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.179500    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.193559 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.180029    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.233113 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.233032    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhbc\" (UniqueName: \"kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.353800 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.353526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:02.790737 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:02.790665    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-679f8f864b-9b6s6"]
Oct 30 21:45:02.794695 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:02.794662    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648997b6_6ac2_41db_9d70_ced80bde4874.slice/crio-688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af WatchSource:0}: Error finding container 688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af: Status 404 returned error can't find the container with id 688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af
Oct 30 21:45:03.048493 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:03.048416    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"414719bddd107ac835fca0d68fc7964c66bb4c6b07d27edc54d7ae4b1ff55959"}
Oct 30 21:45:03.048956 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:03.048504    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"ea09d8cbf17fd7202de31debdce5df1621069e3b36bedc110e6023dacd698f5b"}
Oct 30 21:45:03.048956 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:03.048546    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"6343dbb7be6672c7b8c77d8961198e88554ae5ca1fd75e3d2ff45f76f066d76e"}
Oct 30 21:45:03.051174 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:03.051145    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6" event={"ID":"648997b6-6ac2-41db-9d70-ced80bde4874","Type":"ContainerStarted","Data":"688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af"}
Oct 30 21:45:04.062990 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.062957    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"fd43e47fb83887efc515653ec307a2923ced68765f8bfad72a6947f7e8af63ad"}
Oct 30 21:45:04.063297 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.063031    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"1388c0c627f8c13d4dcdc3337e251fdf5a7f11e6c665bdf22b146b07b9e615c6"}
Oct 30 21:45:04.063297 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.063058    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"c2b6f11c78b483c90327b2bbee839e5f7734c53bc5deafe398caa6b080451bec"}
Oct 30 21:45:04.063297 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.063089    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"3f97cdca009e1668d48935db6c838d4f76f6b74ca9757e5adcd13b626b110f12"}
Oct 30 21:45:04.063297 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.063113    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"64db679655b6b38e73d2093617ca84a308e2629461d672c420873b79923b9f66"}
Oct 30 21:45:04.067035 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.067005    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"c11c2497d1ce40b3695a8297f5288c1c67b04f9a4225a7ca9d7c9af0f82a9b46"}
Oct 30 21:45:04.069473 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.069448    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b" event={"ID":"8aa5ed76-7b28-4719-a111-512d990b5e70","Type":"ContainerStarted","Data":"bf99947aac30f2b664fbd6867ee0136cd435786f99b718f82faef476c8681049"}
Oct 30 21:45:04.071450 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.071428    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:04.076073 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.076044    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:04.186276 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.186222    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b" podStartSLOduration=1.9697250309999998 podStartE2EDuration="4.186208315s" totalImagesPullingTime="2.216483284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:04.185716695 +0000 UTC m=+64.928936908" watchObservedRunningTime="2026-10-30 21:45:04.186208315 +0000 UTC m=+64.929428526"
Oct 30 21:45:04.694708 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.694683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:04.694824 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.694744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:04.746318 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.746286    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:45:04.746477 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.746398    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:45:04.758051 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.758025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:04.758165 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.758027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:04.796219 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.796181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:04.847766 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.847710    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:45:04.907693 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.907612    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:45:04.920777 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.920747    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:04.975693 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.975664    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2rr9\""
Oct 30 21:45:04.979902 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.979875    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ph4bx\""
Oct 30 21:45:04.984137 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.984109    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6ptf6\""
Oct 30 21:45:04.985116 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.985086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:04.988813 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.988793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:04.993319 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:04.993304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:05.088164 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.088139    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerStarted","Data":"ae277f9a846d5b09391b604d91f3c2ba81f1a1ca7de5ce541ffec90ecd924a81"}
Oct 30 21:45:05.092254 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.091644    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"f9324584aadc9c6efb59352e0bc43a3ae13d6935b9bb30f483b2cf3e4b1bfe6d"}
Oct 30 21:45:05.092254 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.091700    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" event={"ID":"f91247e1-6c15-4eb3-909c-4145e59ec71a","Type":"ContainerStarted","Data":"e0c2b60f93819ee42c50de4a24bcc110b41543db16fd61447151d22a1e3f7e53"}
Oct 30 21:45:05.092254 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.091921    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:05.093958 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.093936    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb" event={"ID":"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed","Type":"ContainerStarted","Data":"45571eeefcfa6732359634cc1a934f007ac9518eed995c486c2998a93c46acf2"}
Oct 30 21:45:05.219551 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.219504    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.51229519 podStartE2EDuration="7.219491625s" totalImagesPullingTime="4.692918314s" totalInitContainerRuntime="14.278121ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:05.218639764 +0000 UTC m=+65.961860001" watchObservedRunningTime="2026-10-30 21:45:05.219491625 +0000 UTC m=+65.962711836"
Oct 30 21:45:05.337630 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.337573    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb" podStartSLOduration=2.166881608 podStartE2EDuration="4.337557193s" totalImagesPullingTime="2.170675585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:05.336524544 +0000 UTC m=+66.079744755" watchObservedRunningTime="2026-10-30 21:45:05.337557193 +0000 UTC m=+66.080777404"
Oct 30 21:45:05.379237 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.379209    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg4h9"]
Oct 30 21:45:05.383040 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:05.383017    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b42278_c848_4e19_8312_e235b5027b97.slice/crio-987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5 WatchSource:0}: Error finding container 987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5: Status 404 returned error can't find the container with id 987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5
Oct 30 21:45:05.428074 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.427887    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlsms"]
Oct 30 21:45:05.429996 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.429972    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmc55"]
Oct 30 21:45:05.430476 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:05.430356    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a0b339_36a2_46de_a121_7399125b6d6f.slice/crio-6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4 WatchSource:0}: Error finding container 6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4: Status 404 returned error can't find the container with id 6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4
Oct 30 21:45:05.432781 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:05.432760    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa25fa1_62fb_44e6_a0de_1b885cea1c73.slice/crio-98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e WatchSource:0}: Error finding container 98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e: Status 404 returned error can't find the container with id 98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e
Oct 30 21:45:05.477390 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.477328    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27" podStartSLOduration=3.41112783 podStartE2EDuration="7.477313596s" totalImagesPullingTime="4.066185766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:05.47634767 +0000 UTC m=+66.219567934" watchObservedRunningTime="2026-10-30 21:45:05.477313596 +0000 UTC m=+66.220533818"
Oct 30 21:45:05.687296 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.687211    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:45:05.693257 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.693231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.746126 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746090    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:45:05.746126 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746090    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:45:05.746331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746101    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ulvdr33ekapg\""
Oct 30 21:45:05.746331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746093    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:45:05.746331 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746149    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:45:05.746444 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746431    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:45:05.746497 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746431    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mcz8h\""
Oct 30 21:45:05.746700 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746684    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:45:05.746700 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746697    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:45:05.746807 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746745    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:45:05.746936 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746916    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:45:05.746980 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.746969    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:45:05.747286 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.747275    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:45:05.747410 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.747393    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:45:05.798006 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.797967    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:45:05.798398 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.798355    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:45:05.799780 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.799764    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:45:05.805353 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805427 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805482 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805527 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805587 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805616 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805647 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805647 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805713 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805743 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805771 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805824 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805868 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805909 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805939 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805970 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.805970 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.806064 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.805992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.806064 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.806045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.806119 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.806069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907100 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907100 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907333 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907333 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907333 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.907333 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.908188 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.907967    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.909189 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.908286    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.909189 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.908536    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.910606 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.910006    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.910606 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.910093    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.910606 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.910561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.911177 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.911157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.911992 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.911972    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.912266 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.912251    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.912715 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.912697    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.913214 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.913177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.914437 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.913923    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.914437 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.914389    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.914770 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.914724    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.914770 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.914744    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.915064 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.915037    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.915986 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.915959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.916227 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.916199    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.916667 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.916647    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:05.975335 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:05.975311    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:06.028470 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.028442    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:06.099138 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.099096    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmc55" event={"ID":"cfa25fa1-62fb-44e6-a0de-1b885cea1c73","Type":"ContainerStarted","Data":"98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e"}
Oct 30 21:45:06.101562 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.101538    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6" event={"ID":"648997b6-6ac2-41db-9d70-ced80bde4874","Type":"ContainerStarted","Data":"376145ffc78162b060703e024422faa15c3dcbb28be2316420028a94371dc9df"}
Oct 30 21:45:06.101669 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.101599    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6" event={"ID":"648997b6-6ac2-41db-9d70-ced80bde4874","Type":"ContainerStarted","Data":"8d8600f04a9cd9b1fb3f61ca19886d8f530a3a80838647eb688e11436388b7dd"}
Oct 30 21:45:06.101669 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.101628    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6" event={"ID":"648997b6-6ac2-41db-9d70-ced80bde4874","Type":"ContainerStarted","Data":"a55580cfcc64d24284947dcbb68aea94c0cffc78625b91eb1fa6eaad30cbdfc3"}
Oct 30 21:45:06.102935 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.102904    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg4h9" event={"ID":"06b42278-c848-4e19-8312-e235b5027b97","Type":"ContainerStarted","Data":"987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5"}
Oct 30 21:45:06.104802 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.104761    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlsms" event={"ID":"50a0b339-36a2-46de-a121-7399125b6d6f","Type":"ContainerStarted","Data":"6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4"}
Oct 30 21:45:06.226404 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.226278    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6" podStartSLOduration=2.960975397 podStartE2EDuration="5.22626201s" totalImagesPullingTime="2.265286613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:06.225091371 +0000 UTC m=+66.968311583" watchObservedRunningTime="2026-10-30 21:45:06.22626201 +0000 UTC m=+66.969482223"
Oct 30 21:45:06.463429 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:06.463354    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:45:06.466192 ip-10-0-130-176 kubenswrapper[2578]: W1030 21:45:06.466138    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d61ed8f_d2c8_41d3_bed6_24f0376c52cd.slice/crio-f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce WatchSource:0}: Error finding container f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce: Status 404 returned error can't find the container with id f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce
Oct 30 21:45:07.124643 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:07.124605    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9" exitCode=0
Oct 30 21:45:07.126320 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:07.125065    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9"}
Oct 30 21:45:07.126320 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:07.125157    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerStarted","Data":"f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce"}
Oct 30 21:45:08.135726 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:08.135682    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlsms" event={"ID":"50a0b339-36a2-46de-a121-7399125b6d6f","Type":"ContainerStarted","Data":"05d730e3048bc7c6840ff2173028f39812b3eee88c83498fb62b9a65b47dc755"}
Oct 30 21:45:08.136211 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:08.135757    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlsms" event={"ID":"50a0b339-36a2-46de-a121-7399125b6d6f","Type":"ContainerStarted","Data":"7cfc7dbb9cf58a9fd15740cb65e6f16739db609a6d25b00f8f14bcccfba37bee"}
Oct 30 21:45:08.254587 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:08.254530    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rlsms" podStartSLOduration=67.588897239 podStartE2EDuration="1m9.254513471s" totalImagesPullingTime="1.665616232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:08.253456646 +0000 UTC m=+68.996676858" watchObservedRunningTime="2026-10-30 21:45:08.254513471 +0000 UTC m=+68.997733681"
Oct 30 21:45:11.113737 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:11.113701    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:11.152922 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:11.152887    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg4h9" event={"ID":"06b42278-c848-4e19-8312-e235b5027b97","Type":"ContainerStarted","Data":"8eb6ba92af9b2ed70cb30c874a720ea3490526987844c73b68866d84d0315232"}
Oct 30 21:45:11.153114 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:11.153044    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:11.364551 ip-10-0-130-176 kubenswrapper[2578]: I1030 21:45:11.364457    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hg4h9" podStartSLOduration=67.641217091 podStartE2EDuration="1m12.364442126s" totalImagesPullingTime="4.723225035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:11.363887365 +0000 UTC m=+72.107107578" watchObservedRunningTime="2026-10-30 21:45:11.364442126 +0000 UTC m=+72.107662363"
Oct 30 21:45:11.805059 ip-10-0-130-176 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:45:11.820888 ip-10-0-130-176 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:45:11.821060 ip-10-0-130-176 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:45:11.821112 ip-10-0-130-176 systemd[1]: kubelet.service: Consumed 4.637s CPU time.
Oct 30 21:45:11.831173 ip-10-0-130-176 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:45:11.917756 ip-10-0-130-176 kubenswrapper[5967]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:45:11.917756 ip-10-0-130-176 kubenswrapper[5967]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:45:11.917756 ip-10-0-130-176 kubenswrapper[5967]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:45:11.917756 ip-10-0-130-176 kubenswrapper[5967]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:45:11.919861 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919778    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.919861 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919862    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.919861 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919865    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919869    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919872    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919875    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919877    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919880    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919882    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919885    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919888    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919891    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919893    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919901    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919904    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919909    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919913    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919917    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919920    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919923    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919926    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.919956 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919928    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919931    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919934    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919937    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919940    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919943    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919946    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919949    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919951    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919954    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919957    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919960    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919962    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919968    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919972    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919975    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919978    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919982    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919985    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.920403 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919988    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919990    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919993    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919995    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.919998    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920000    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920003    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920006    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920008    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920011    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920013    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920016    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920019    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920021    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920024    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920027    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920029    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920032    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920035    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920037    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.920841 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920040    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920042    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920045    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920047    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920050    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920052    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920055    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920057    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920059    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920062    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920064    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920067    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920069    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920071    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920074    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920076    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920079    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920081    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920083    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920086    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.921315 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920089    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920092    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920094    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920097    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920099    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920102    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920105    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920107    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920110    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920112    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920115    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920118    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920121    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920123    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920125    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920128    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920130    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920133    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920135    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.921795 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920137    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920140    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920142    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920144    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920147    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920149    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920153    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920931    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920938    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920941    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920944    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920947    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920949    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920952    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920955    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920958    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920961    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920963    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920966    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920971    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.922256 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920974    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920976    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920979    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920981    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920984    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920986    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920989    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920992    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920994    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920997    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.920999    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921002    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921004    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921007    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921010    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921012    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921015    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921019    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921023    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.922749 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921026    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921029    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921031    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921034    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921036    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921039    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921042    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921045    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921047    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921050    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921052    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921054    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921059    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921061    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921064    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921066    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921069    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921071    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921073    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921076    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.923223 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921079    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921081    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921084    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921086    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921089    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921092    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921094    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921097    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921100    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921102    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921105    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921107    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921110    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921112    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921115    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921118    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921120    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921123    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921125    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921127    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.923712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921131    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921133    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921135    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921138    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921142    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921144    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921146    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921149    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921151    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921154    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921156    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921159    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921161    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921164    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921166    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921168    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921171    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921175    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921179    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.924194 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921182    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921184    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921186    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921189    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921192    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921194    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921197    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921199    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921201    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921204    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921206    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921209    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921211    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921214    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921224    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921829    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921836    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921840    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921843    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.924652 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921846    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921849    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921852    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921854    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921857    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921860    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921863    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921865    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921868    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921873    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921875    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921878    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921880    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921883    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921885    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921887    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921890    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921892    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921897    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.925095 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921900    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921904    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921907    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921909    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921912    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921914    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921917    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921919    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921922    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921925    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921927    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921930    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921933    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921935    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921938    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921940    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921944    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921946    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921949    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.925563 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921951    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921954    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921956    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921961    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921964    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921966    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921969    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921971    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921974    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921976    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921979    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921982    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921986    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921988    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921991    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921993    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921996    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.921998    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922001    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.926046 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922003    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922006    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922008    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922011    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922014    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922017    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922019    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922022    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922024    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922026    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922029    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922031    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922034    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922036    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922038    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922041    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922045    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922048    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922050    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.926712 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922053    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922056    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922058    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922060    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922063    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922065    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922068    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922070    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922073    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922075    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922078    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922080    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922082    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922087    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922089    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922091    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922094    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922097    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922099    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922102    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.927324 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922104    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922106    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922109    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922111    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922113    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922116    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922209    5967 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922221    5967 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922234    5967 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922240    5967 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922244    5967 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922247    5967 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922251    5967 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922259    5967 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922263    5967 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922266    5967 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922271    5967 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922274    5967 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922277    5967 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922280    5967 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922283    5967 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922286    5967 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922289    5967 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:45:11.927805 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922292    5967 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922296    5967 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922299    5967 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922302    5967 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922305    5967 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922308    5967 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922312    5967 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922316    5967 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922319    5967 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922322    5967 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922325    5967 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922328    5967 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922331    5967 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922334    5967 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922337    5967 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922341    5967 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922344    5967 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922347    5967 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922350    5967 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922353    5967 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922356    5967 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922360    5967 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922363    5967 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922381    5967 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:45:11.928386 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922385    5967 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922392    5967 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922398    5967 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922402    5967 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922407    5967 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922411    5967 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922416    5967 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922420    5967 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922423    5967 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922426    5967 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922429    5967 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922432    5967 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922435    5967 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922439    5967 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922442    5967 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922445    5967 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922455    5967 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922458    5967 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922461    5967 flags.go:64] FLAG: --help="false"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922464    5967 flags.go:64] FLAG: --hostname-override="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922468    5967 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922471    5967 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922473    5967 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:45:11.928993 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922477    5967 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922480    5967 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922483    5967 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922486    5967 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922488    5967 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922491    5967 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922494    5967 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922497    5967 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922500    5967 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922503    5967 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922508    5967 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922511    5967 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922513    5967 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922516    5967 flags.go:64] FLAG: --lock-file=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922519    5967 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922538    5967 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922541    5967 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922547    5967 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922550    5967 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922553    5967 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922555    5967 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922558    5967 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922561    5967 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922564    5967 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922567    5967 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:45:11.929553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922571    5967 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922580    5967 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922584    5967 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922587    5967 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922590    5967 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922593    5967 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922595    5967 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922598    5967 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922601    5967 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922604    5967 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922610    5967 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922613    5967 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922616    5967 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922619    5967 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922622    5967 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922625    5967 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922627    5967 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922632    5967 flags.go:64] FLAG: --port="10250"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922635    5967 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922638    5967 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-02c91fd2e98a650db"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922641    5967 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922644    5967 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922646    5967 flags.go:64] FLAG: --register-node="true"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922649    5967 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922653    5967 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922656    5967 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:45:11.930134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922658    5967 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922661    5967 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922665    5967 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922668    5967 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922671    5967 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922674    5967 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922677    5967 flags.go:64] FLAG: --runonce="false"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922680    5967 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922688    5967 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922691    5967 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922694    5967 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922697    5967 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922699    5967 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922702    5967 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922706    5967 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922708    5967 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922711    5967 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922714    5967 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922717    5967 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922720    5967 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922722    5967 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922726    5967 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922731    5967 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922735    5967 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922738    5967 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:45:11.930756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922745    5967 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922748    5967 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922751    5967 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922754    5967 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922757    5967 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922760    5967 flags.go:64] FLAG: --v="2"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922764    5967 flags.go:64] FLAG: --version="false"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922768    5967 flags.go:64] FLAG: --vmodule=""
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922772    5967 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.922775    5967 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922935    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922939    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922942    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922945    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922948    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922952    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922957    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922961    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922963    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922965    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922968    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.931339 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922971    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922973    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922976    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922979    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922981    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922984    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922987    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922991    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922993    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.922997    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923000    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923002    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923005    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923008    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923010    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923013    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923015    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923017    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923020    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923022    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.931856 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923025    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923027    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923030    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923032    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923034    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923037    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923040    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923042    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923045    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923047    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923050    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923053    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923057    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923064    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923067    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923070    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923072    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923075    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.932320 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923077    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923081    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923084    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923088    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923091    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923093    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923095    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923098    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923100    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923103    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923105    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923108    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923110    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923113    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923115    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923118    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923120    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923123    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923125    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923128    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.932863 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923130    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923132    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923135    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923143    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923145    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923148    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923150    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923153    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923155    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923157    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923160    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923162    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923165    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923170    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923172    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923176    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923178    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923181    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923183    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.933713 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923186    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923188    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923191    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923193    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923196    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923198    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923201    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923203    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923206    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923208    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923211    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923213    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923215    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923218    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923221    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923223    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923226    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.934452 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923230    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.923256    5967 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923295    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923299    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923302    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923305    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923308    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923310    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923312    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923315    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923319    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923323    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923326    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923328    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923331    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923333    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.934893 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923336    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923338    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923341    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923343    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923346    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923348    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923350    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923353    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923355    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923358    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923360    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923363    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923379    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923384    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923388    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923392    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923395    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923400    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923404    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923408    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.935268 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923411    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923413    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923416    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923418    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923421    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923423    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923429    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923434    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923436    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923439    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923442    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923444    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923447    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923450    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923452    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923455    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923457    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923460    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923462    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923465    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.935877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923467    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923470    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923472    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923475    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923477    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923480    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923482    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923485    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923487    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923489    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923492    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923495    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923497    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923500    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923502    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923505    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923507    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923510    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923514    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923517    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.936447 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923520    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923522    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923525    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923528    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923532    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923536    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923539    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923542    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923544    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923547    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923550    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923552    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923554    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923557    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923559    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923562    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923564    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923567    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.937076 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923570    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923572    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923575    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923577    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923580    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923583    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923587    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923589    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923592    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923594    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923597    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923599    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923603    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.923607    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.928480    5967 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.928496    5967 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.928515    5967 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.928520    5967 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928580    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928585    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.937616 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928588    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928592    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928595    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928597    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928600    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928602    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928605    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928608    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928612    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928616    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928620    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928624    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928628    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928632    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928636    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928639    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928642    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928645    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928649    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928654    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.938085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928658    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928662    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928666    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928668    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928671    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928674    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928678    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928681    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928683    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928686    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928689    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928692    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928696    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928700    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928704    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928709    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928711    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928714    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928716    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928719    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.938575 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928722    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928724    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928727    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928729    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928733    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928735    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928738    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928740    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928743    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928746    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928748    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928751    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928754    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928756    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928759    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928761    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928764    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928768    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928771    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928774    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.939038 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928776    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928779    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928782    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928785    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928788    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928790    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928793    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928795    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928798    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928801    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928803    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928806    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928808    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928811    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928815    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928819    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928822    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928826    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928829    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.939520 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928832    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928834    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928836    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928841    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928845    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928850    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928853    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928855    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928857    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928860    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928863    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928866    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928870    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928875    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928878    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928881    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928884    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928887    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928890    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.939963 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928892    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928895    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928898    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928900    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928902    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.928905    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.928939    5967 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929087    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929092    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929095    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929097    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929100    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929103    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929106    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929108    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929111    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.940458 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929114    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929117    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929120    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929123    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929125    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929128    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929130    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929133    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929136    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929138    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929141    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929143    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929146    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929148    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929150    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929153    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929155    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929158    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929160    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.941087 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929164    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929168    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929171    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929174    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929177    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929180    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929182    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929185    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929188    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929190    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929194    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929196    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929199    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929201    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929204    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929207    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929209    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929212    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929214    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929216    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.941959 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929219    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929221    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929224    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929226    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929229    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929231    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929234    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929236    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929238    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929242    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929246    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929248    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929251    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929253    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929256    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929258    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929260    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929263    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929266    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.942590 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929268    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929271    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929273    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929276    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929279    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929282    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929294    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929297    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929299    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929302    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929305    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929307    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929311    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929315    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929319    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929324    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929328    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929331    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929335    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929339    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.943126 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929342    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929346    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929350    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929353    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929357    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929360    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929364    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929395    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929400    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929404    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929408    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929410    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929413    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929416    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929418    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929420    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929423    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929432    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.943627 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929435    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.929465    5967 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929499    5967 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929503    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929506    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929509    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929511    5967 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929514    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929516    5967 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929519    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929522    5967 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929524    5967 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929527    5967 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929529    5967 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929532    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929539    5967 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:45:11.944130 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929542    5967 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929545    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929547    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929549    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929552    5967 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929555    5967 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929557    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929560    5967 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929563    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929565    5967 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929569    5967 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929571    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929574    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929576    5967 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929580    5967 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929584    5967 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929588    5967 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929591    5967 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929593    5967 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:45:11.944699 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929596    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929598    5967 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929601    5967 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929604    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929606    5967 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929609    5967 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929612    5967 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929614    5967 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929617    5967 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929619    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929622    5967 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929624    5967 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929626    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929629    5967 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929631    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929634    5967 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929636    5967 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929639    5967 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929641    5967 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929644    5967 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:45:11.945157 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929646    5967 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929649    5967 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929651    5967 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929654    5967 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929662    5967 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929665    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929668    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929671    5967 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929674    5967 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929678    5967 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929682    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929684    5967 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929687    5967 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929690    5967 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929693    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929695    5967 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929698    5967 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929700    5967 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929703    5967 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:45:11.945672 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929705    5967 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929708    5967 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929710    5967 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929713    5967 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929715    5967 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929717    5967 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929720    5967 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929722    5967 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929725    5967 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929729    5967 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929732    5967 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929734    5967 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929737    5967 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929739    5967 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929742    5967 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929744    5967 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929747    5967 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929751    5967 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929753    5967 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929756    5967 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:45:11.946162 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929758    5967 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929761    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929763    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929766    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929770    5967 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929773    5967 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929775    5967 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929778    5967 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929780    5967 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929783    5967 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929785    5967 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929787    5967 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929790    5967 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:11.929792    5967 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.929853    5967 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.930821    5967 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.930880    5967 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.931058    5967 server.go:1014] "Starting client certificate rotation"
Oct 30 21:45:11.946721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.931199    5967 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.931240    5967 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:38:59 +0000 UTC" deadline="2028-03-25 10:17:15.260038253 +0000 UTC"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.931267    5967 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12276h32m3.328773207s"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.931530    5967 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.932612    5967 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.934044    5967 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.936100    5967 log.go:25] "Validated CRI v1 image API"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.936919    5967 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:45:11.947180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.939443    5967 fs.go:135] Filesystem UUIDs: map[5dbb9917-1937-4366-afbf-19b6bb84a139:/dev/nvme0n1p3 72752232-9ebe-4ae0-a5bd-fab00c74e340:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Oct 30 21:45:11.947429 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.939460    5967 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199/userdata/shm major:0 minor:281 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f/userdata/shm major:0 minor:364 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52954b4df8262e32c4b13c0206de7e1e1e68831da6ad588529530fbcd5a29c6c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52954b4df8262e32c4b13c0206de7e1e1e68831da6ad588529530fbcd5a29c6c/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4/userdata/shm major:0 minor:456 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271/userdata/shm major:0 minor:275 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5/userdata/shm major:0 minor:457 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e/userdata/shm major:0 minor:460 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0/userdata/shm major:0 minor:279 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d/userdata/shm major:0 minor:358 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957/userdata/shm major:0 minor:350 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f0e0d00b8f4a6d39d14d124472b4e77a00ce0e5870e1af200beaf831ac306a12/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f0e0d00b8f4a6d39d14d124472b4e77a00ce0e5870e1af200beaf831ac306a12/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce/userdata/shm major:0 minor:496 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06b42278-c848-4e19-8312-e235b5027b97/volumes/kubernetes.io~projected/kube-api-access-t7g76:{mountpoint:/var/lib/kubelet/pods/06b42278-c848-4e19-8312-e235b5027b97/volumes/kubernetes.io~projected/kube-api-access-t7g76 major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~projected/kube-api-access-zllr4:{mountpoint:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~projected/kube-api-access-zllr4 major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~projected/kube-api-access-kj4z2:{mountpoint:/var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~projected/kube-api-access-kj4z2 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/config-reloader/2 major:0 minor:487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/prometheus/15 major:0 minor:487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~empty-dir/config-out major:0 minor:484 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/kube-api-access-jw5q9:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/kube-api-access-jw5q9 major:0 minor:495 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/tls-assets major:0 minor:493 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/config major:0 minor:491 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:494 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:486 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:485 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:488 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:489 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:490 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:492 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/web-config major:0 minor:487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30afacbf-8146-41aa-9298-672a74a30f81/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/30afacbf-8146-41aa-9298-672a74a30f81/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~projected/kube-api-access-xvwsz:{mountpoint:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~projected/kube-api-access-xvwsz major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~projected/kube-api-access-hgxzh:{mountpoint:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~projected/kube-api-access-hgxzh major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~projected/kube-api-access-vrxfp:{mountpoint:/var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~projected/kube-api-access-vrxfp major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~secret/metrics-certs major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/alertmanager/9 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/config-reloader/6 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~empty-dir/config-out major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/kube-api-access-8wq2k:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/kube-api-access-8wq2k major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/tls-assets major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/config-volume major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/web-config major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~projected/kube-api-access-58mzw:{mountpoint:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~projected/kube-api-access-58mzw major:0 minor:278 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~projected/kube-api-access-hfhbc:{mountpoint:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~projected/kube-api-access-hfhbc major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~projected/kube-api-access-67jsq:{mountpoint:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~projected/kube-api-access-67jsq major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~projected/kube-api-access-7pjrc:{mountpoint:/var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~projected/kube-api-access-7pjrc major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc/volumes/kubernetes.io~projected/kube-api-access-klbmp:{mountpoint:/var/lib/kubelet/pods/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc/volumes/kubernetes.io~projected/kube-api-access-klbmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~projected/kube-api-access-9q24j:{mountpoint:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~projected/kube-api-access-9q24j major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9c422a1f-05d8-4970-b87e-f2d5d5302cc0/volumes/kubernetes.io~projected/kube-api-access-vgfsp:{mountpoint:/var/lib/kubelet/pods/9c422a1f-05d8-4970-b87e-f2d5d5302cc0/volumes/kubernetes.io~projected/kube-api-access-vgfsp major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~projected/kube-api-access-glrrr:{mountpoint:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~projected/kube-api-access-glrrr major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~projected/kube-api-access-5tqmf:{mountpoint:/var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~projected/kube-api-access-5tqmf major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~secret/cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~projected/kube-api-access-hrcs7:{mountpoint:/var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~projected/kube-api-access-hrcs7 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd926117-3d33-4749-bb15-e44f4067a47d/volumes/kubernetes.io~projected/kube-api-access-4vsc4:{mountpoint:/var/lib/kubelet/pods/bd926117-3d33-4749-bb15-e44f4067a47d/volumes/kubernetes.io~projected/kube-api-access-4vsc4 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cfa25fa1-62fb-44e6-a0de-1b885cea1c73/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/cfa25fa1-62fb-44e6-a0de-1b885cea1c73/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7/volumes/kubernetes.io~projected/kube-api-access-c2jg9:{mountpoint:/var/lib/kubelet/pods/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7/volumes/kubernetes.io~projected/kube-api-access-c2jg9 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d53e9c7e-0933-40df-9112-c2422d49300a/volumes/kubernetes.io~projected/kube-api-access-vmn8t:{mountpoint:/var/lib/kubelet/pods/d53e9c7e-0933-40df-9112-c2422d49300a/volumes/kubernetes.io~projected/kube-api-access-vmn8t major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f28179ea-90f6-4da2-a71d-ac889d8795b2/volumes/kubernetes.io~projected/kube-api-access-7b5c7:{mountpoint:/var/lib/kubelet/pods/f28179ea-90f6-4da2-a71d-ac889d8795b2/volumes/kubernetes.io~projected/kube-api-access-7b5c7 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~projected/kube-api-access-hxx6b:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~projected/kube-api-access-hxx6b major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:344 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/0a1da01736f3fff92c45a019e57f8f4500e2c9b101e099ff6bf0c379c2926410/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/f47f189b006b3f7038c59bc84571e2e87c09dc2fe6b8c441aad5ae199ac94489/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/07d94f52822c9369247ac03a075644848815c71d53b41529b33531655b636ee0/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/3970b7b00f24dce1ed5ee39fe283f15f3e283313fcdc858f459428744bd84136/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7d972c6f75d7c55667d97fae8dbcf3d1a68905419e3575991c7218325f5cfd94/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/0bf9c23509ae9f3417c144a80cffdb82ab489a3ced38f03fcb2813920d58715b/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/95dd9b43bb37467fe14d77f631f05ebaa8c041b9a6221a81fe026388c281cac0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/f2cc7b954b0ce93169e1e163627c61ca970cdbc97ad252df255b952ab87ae46c/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/ddbf9131d2c987e5c796a09855c913ecfb2fb7e50612460ebad38f07f092e1ba/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/538ab15fb191ea84b363517f085e7cb85cab6bea2ce7bb0967c3e2fc4913f90d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/b03da38e95608c2a0a956c3945928adccb255bd4770a1c5e67b4a69cdd614b67/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/9def1f43fe243d3b9ed7bb5a77f99f92fedf0e4503f52995a5965f6948610830/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/2fe95422490cb942df485dc78752675f9cac729605725b42f7f6edbcf41181ac/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/39cea8cee508f390f72e91299983b2e2f6d67c0125d6104eaf431d18658b6048/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/0e586643103bed713d1311cceee55ca97a44da126fb0bf3d95402550f80e1dad/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/45760f392f459a0fcfe7d85ad139637fc9054eb450993d2c724fcc1da4ecdfbc/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/d3b468a42dbcebaa9466a4d55ca00241746d72aa0bc9ad044c91e3f1480adeaa/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/4be0b4890193a22d1f4bab86240cb03e5e50e849cc1b7066018cfac5b4d0d56f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/f140cd7ea8bc39a10fc6dc36a6b44441f31a5b524a356b1b3031b1c32a30be9b/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d0bad4464547a97d96a9166b0a2d712097c0ae06dd0e354894f72dcc2b8e7543/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/6a26c006eaabac79236fa2da91f8b1b187113aa842b23b2d5894521ada7f20c2/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/fe2d760e70761fdf38d9a3a1b38d77fd18b2cc4472063bb05820b07eac8624e5/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/d5ccc3eb26c77e596efc7020239b1342260a69a91d02eb6ea95cf63fd1c16167/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/e3dace6eaf2a93ecca712d079e639dc683696e282953b0091e2781f438a71f01/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/a516e143766ecd32d39efc23c12f3aeef10c201d561d32fbad229bd15c8b790b/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/3c6cab001273fb9c96e0e1202096b065633e970d67bec05c2e8f19ece8c7a6eb/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/f5ec86223b2d3113ca4029df88e2f3628d4496dfc52b6530bd9279bc976ae31e/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/92da77bfaed3babc5072d16c05736e75acfc7e3769065407ea2900b5beae984d/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/abad1536bc9b811b7b4ed0600c6d954040fa82aac8153a4fb1de66d4aeff7c76/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/8d370725b0db658b226760414df6c05e978d88ad41066bd2df1a41afca1d271e/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/d9b7c658aa3787b6008785970e6192cc0c90e1daff3d8a98dc1e31302126262e/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/2f258d608433ed89b88f02b8c67ea3535c3cf2125ae42855bc86523b6fc1bdb7/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/e78c063bd52113dc946a28a42bc8f4d4d3d7b6f304e43d59e40158ff71d9aab4/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/d050cc47c87a3f2fa8772d8d9ec12e69d991cad56ccfe887a2795e3fa8ea6e82/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/9b6fd208258ac48e8a045381ea5bc504dc9ef1d568262689b53705b00b010460/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/5e419384fc5b7a73372f86ae1dbe77399c46a17f861765ce38617ef03c739ba2/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/83bdf391af2467ce37661121c7363f0c52e242eeadf40ec1ea9fcc949a0e816c/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/6e3af923d63edb06ee82383540e3d24781a5a68acc0c36aa1b855722a64fd901/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/45a11f325111aa9756e1ebafa656270678ed2886615f1200e9f37880fd5686c9/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/0499de49bf9ef3a524ff7e498e8ca57a398501d0091c048821a6be34bf25abd4/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/a0e8b52b4df9f2144efd7e6bcdff332086edada7f8a18d26f6e56a29482c3ae9/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/b6f8fc5091aacb63c5b811497f271416a07279b756f7b0e4458c44110bf8ac5c/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/34802c1c858265151d1098bef4dfcadd7011f5a54bfd33cd0c47e8d834bc3bd0/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/8989f440ec81de090e48b74889855a1268b2720f5b247ab2732519601adf9d9f/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/6128d311e2a8b1588dca425b2ce59a69ba3f0df430e6a5931f7425d9fe5eb250/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/575e14fd9e779f8cacfd51fab0fa6d71dd8773226d0d7bf7ffb49cdcf1e8dbd3/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/d942b5a3a759fb84bfe6b61e9d3998b4d68e11c309d6fd751c347f693ede615f/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/a446a9a05f06025c7e258643da0857081b762f7e7f855886315a5d42b7ce2695/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/e1ae06a111a46312d36b0a0180d8b61dfc9e33b8fb091f111b302cee9e588548/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/d16c8c2d8cbc076fc23d201b891262217f9acc102b5dd46feb1dc99ab939c70b/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/bee30327fb847b5698309b82f7f0560a088682fc03195b2b140fcda1fafc1460/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/ac966a284f34188bd4c16ea87de2e25a99decfe4351029a74bf74274c564c62a/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/6f253b24f9b19a8d393b9e22d7e6958f1dd5517c831a02f630d22378129da956/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/479325f4b74bc666322d2c169820e5690cf15ed7531184893a1b126e6acfc140/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/c0f20b51e45e4fb6aebd60a761a486626abc97032a3782b8c11c16af16920cd7/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/e30c714312da33971a1860592a9e9aba31833f8068768faf44560a2bb074dabb/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/c75d189e466e2842a0db895e8531f063d4d5a97605acfe8daa4d3ceef741975c/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/2102a15bda2c35864453c7856dc71c9110a2ba8dca89222f55252597aa54a6ef/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/81e0c763961d136c70f32daab400e3dba96d37fac0a70ba8fffe9755634dbb0e/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/6e6e6c83eca1f752cedf0842eeaf1d786152b37f9abccf8758cab3fa62911e06/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/3c98ef39a00e6a46288bee5d435d9dc7e98e050ccd12482a94e7df0f5aef6bc1/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/e1a68c15fbc3dbd45a02b69e853df2102ed663e9b1acee2538db0b44f0a10a49/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/a27733cb436676c318f696ddfe7fc0144f87f60eb159b5d42bf2319b379ebc84/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-462:{mountpoint:/var/lib/containers/storage/overlay/93bf52436ebb44643d114f66efa9a01abc35a59470d238dfaff926604fecce2c/merged major:0 minor:462 fsType:overlay blockSize:0} overlay_0-464:{mountpoint:/var/lib/containers/storage/overlay/d251120559d9f5132e4e715252606a85904de190a1e18cb196602a115e09a598/merged major:0 minor:464 fsType:overlay blockSize:0} overlay_0-470:{mountpoint:/var/lib/containers/storage/overlay/61593029dbaaf66face511b1fcdd8a3eb1533494e80908d8a9eb64ff29a80a80/merged major:0 minor:470 fsType:overlay blockSize:0} overlay_0-475:{mountpoint:/var/lib/containers/storage/overlay/feaaa374f75e04279cc9579d91f97caf1c357e88a4f29a76c743e8f09d15998a/merged major:0 minor:475 fsType:overlay blockSize:0} overlay_0-480:{mountpoint:/var/lib/containers/storage/overlay/d31d21b7a35118f555dcb3717c87e4c121a1ee141e54f6715d416f545d2b1a40/merged major:0 minor:480 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/9252c4219d77ce51b92f9c4ae7a4570f59feac96c322220b7e2f748844496665/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-498:{mountpoint:/var/lib/containers/storage/overlay/8aa4591a085acddd2c2058e1c5a8e9379eeafae3256a9f2b766f37979bc26da4/merged major:0 minor:498 fsType:overlay blockSize:0} overlay_0-500:{mountpoint:/var/lib/containers/storage/overlay/dd23a657e595b50dd6565ae35cd942db6114d50483d964427f1cd61f9bbf68c5/merged major:0 minor:500 fsType:overlay blockSize:0} overlay_0-502:{mountpoint:/var/lib/containers/storage/overlay/e609df9c59812c03a16b7514990ca20ffacd3c3e1be0e2e28d549d74e8fb947a/merged major:0 minor:502 fsType:overlay blockSize:0} overlay_0-508:{mountpoint:/var/lib/containers/storage/overlay/f5e6c9bba27cba4c923f49e9e784e7cad6bb5382eb1f30ad6d98c39f2e2d956d/merged major:0 minor:508 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/11aefc1396368c0b466208d5fcc670f6a34390160ee4369e23196fb841ec13ae/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-519:{mountpoint:/var/lib/containers/storage/overlay/fea5075a7a0d59f5f1235448dfc7abb32892f408f67709a1005ee55de4abbe07/merged major:0 minor:519 fsType:overlay blockSize:0} overlay_0-530:{mountpoint:/var/lib/containers/storage/overlay/f21c752fb545fd7790fcd402937d400fba2f3123ce31703a6490e3b02aaa67d4/merged major:0 minor:530 fsType:overlay blockSize:0} overlay_0-532:{mountpoint:/var/lib/containers/storage/overlay/9cb29d78a5c6135ed70a67629f29db819870ea8b5d2b49fc68f2432547214c2b/merged major:0 minor:532 fsType:overlay blockSize:0} overlay_0-536:{mountpoint:/var/lib/containers/storage/overlay/832b7d7e54a9ec5ccacd5223925fe784f443f2a3477521b88016f18ea5a2dc30/merged major:0 minor:536 fsType:overlay blockSize:0} overlay_0-541:{mountpoint:/var/lib/containers/storage/overlay/0d835b345016509a1fb0e78481656de55031fc1bfd508860c082585515871c29/merged major:0 minor:541 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/17867826dbed7813da39984bd766ad16def025fd7bd35f09e920eb37d9f36ba0/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/5c4d718e879c4161b8b69cc31e51f6fb476428cc9d73044f3104dc3c94f55127/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/6e244efc2fa6130c2a81005af1406f0098eb203f2870c5a604ea3b632a3d6d13/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/0a517c2067a2c378093c08f1857e6569e19f38ca5d8cfed8cdf64eccf9e3949f/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/7f76671d89192b91cebf3bc80c10c7b0605b46b822ef3f1dca13550e0eb8c3c8/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/842d8ef3004f12a1b566ec3aaab786b366238656b65cad97d7f444a217db38d6/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/2c06b73203a461160a4072b186d3622f69063ff6c673b091fa5baa4d03ccfce1/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/673c80fc089a03bd384870547f83862c01ab75c70a165802f8645d26fa7c96da/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/e92e510ed432b7ba2bc87c53a2ebfddc104976bb1d0a23be6468f60a829df733/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7f345f0cdf13201eaef0e4614df4d6fd50c3fa1cde380e389edc5fb83bf03dcd/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:45:11.949499 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.948993    5967 manager.go:217] Machine: {Timestamp:2026-10-30 21:45:11.948512252 +0000 UTC m=+0.063220594 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102491 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24ee5a3a27cb637a39e1cd022310bf SystemUUID:ec24ee5a-3a27-cb63-7a39-e1cd022310bf BootID:3719bd1a-df68-4899-9266-ea3bfa31be50 Filesystems:[{Device:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:48 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d53e9c7e-0933-40df-9112-c2422d49300a/volumes/kubernetes.io~projected/kube-api-access-vmn8t DeviceMajor:0 DeviceMinor:52 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:372 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-480 DeviceMajor:0 DeviceMinor:480 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:494 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:274 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a36c2f5f0160da38c96affd3bf7ea1c4cb3a6d266893fe9852322f279249c3f0/userdata/shm DeviceMajor:0 DeviceMinor:279 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:487 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-530 DeviceMajor:0 DeviceMinor:530 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:302 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:356 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:487 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c194555397b63e8e461e1daf9d525400db54f3b140922186a3b3778c55bcd44/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f0e0d00b8f4a6d39d14d124472b4e77a00ce0e5870e1af200beaf831ac306a12/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:487 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:340 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~projected/kube-api-access-hfhbc DeviceMajor:0 DeviceMinor:374 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:488 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~projected/kube-api-access-kj4z2 DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:223 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:346 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:492 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f460cef1cb412f9642158eda3c7200d71a0693fa591ed78eddae7186a9ea7c9d/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f9021a39414b1c9d66452d8e010cf59cb0b01a9f47920ef831bfb69113c1647d/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~projected/kube-api-access-8wq2k DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:304 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/f28179ea-90f6-4da2-a71d-ac889d8795b2/volumes/kubernetes.io~projected/kube-api-access-7b5c7 DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c1157061003cdd0da6fd1aa6c13b6cac61a849f6a175f6e3955f51e432570cc/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:309 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/081df627-1a6c-47d6-b63b-64ee0d0fbef8/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:345 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4f302fcb636774c7c9dd78cac7335041ee9640b46075d5a524622ad572e3957/userdata/shm DeviceMajor:0 DeviceMinor:350 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~projected/kube-api-access-67jsq DeviceMajor:0 DeviceMinor:363 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:373 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-464 DeviceMajor:0 DeviceMinor:464 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/822de0c91324f9b2610c81fa4ec15e7a50af163fb65e11e7fbb0b0864c14c45b/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a62217-094a-4702-a1c1-f549178905ee/volumes/kubernetes.io~projected/kube-api-access-hrcs7 DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cfa25fa1-62fb-44e6-a0de-1b885cea1c73/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:454 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/98f808080a124a0a80359849c3e7d8615cb64e964197ad135c1aef9b212a6e5e/userdata/shm DeviceMajor:0 DeviceMinor:460 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9c422a1f-05d8-4970-b87e-f2d5d5302cc0/volumes/kubernetes.io~projected/kube-api-access-vgfsp DeviceMajor:0 DeviceMinor:51 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f7ba4baad85b4e1f9d7bf300aceab2595a3e443209dbe977826cefda9a16c044/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:264 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~projected/kube-api-access-zllr4 DeviceMajor:0 DeviceMinor:270 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~projected/kube-api-access-58mzw DeviceMajor:0 DeviceMinor:278 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4bdd0c58-d8d2-44f8-b848-f329c17cff43/volumes/kubernetes.io~projected/kube-api-access-hgxzh DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~projected/kube-api-access-hxx6b DeviceMajor:0 DeviceMinor:349 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/688f2e18807f982c1e3d8463f5c49da57120c5beff6393cc0c3f0d82925855af/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:313 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/06b42278-c848-4e19-8312-e235b5027b97/volumes/kubernetes.io~projected/kube-api-access-t7g76 DeviceMajor:0 DeviceMinor:455 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:484 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:347 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/987cd61c069666da6decab5cd63e8509510130cf58700e8298683498dba78fe5/userdata/shm DeviceMajor:0 DeviceMinor:457 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:486 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:491 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-519 DeviceMajor:0 DeviceMinor:519 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:362 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce/userdata/shm DeviceMajor:0 DeviceMinor:496 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-502 DeviceMajor:0 DeviceMinor:502 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52954b4df8262e32c4b13c0206de7e1e1e68831da6ad588529530fbcd5a29c6c/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:361 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:207 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:485 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:301 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:303 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:370 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-475 DeviceMajor:0 DeviceMinor:475 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:487 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~projected/kube-api-access-vrxfp DeviceMajor:0 DeviceMinor:53 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7/volumes/kubernetes.io~projected/kube-api-access-c2jg9 DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/30afacbf-8146-41aa-9298-672a74a30f81/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:273 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/648997b6-6ac2-41db-9d70-ced80bde4874/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:371 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e91ae0f38d9d546c0b7ea93cd4c244152ccecea2f7eebf18f5e9eed8d5a36cb6/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:344 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:490 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:493 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~projected/kube-api-access-jw5q9 DeviceMajor:0 DeviceMinor:495 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/272fef7cc2cde2d346f504596b8545ac41140593cb293a524a37f054bbea7ec0/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/a7ca3ec5-c805-4cf1-865a-eb0e1b337403/volumes/kubernetes.io~projected/kube-api-access-5tqmf DeviceMajor:0 DeviceMinor:208 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-500 DeviceMajor:0 DeviceMinor:500 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07c28eb9-feb7-44f1-ae79-32a241449056/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:269 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06c3d58e75c16a91a1f1f4ceaf7b67c6e960b5a4f590db5c47b3b935bebfb199/userdata/shm DeviceMajor:0 DeviceMinor:281 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:489 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:224 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8aa5ed76-7b28-4719-a111-512d990b5e70/volumes/kubernetes.io~projected/kube-api-access-7pjrc DeviceMajor:0 DeviceMinor:357 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc/volumes/kubernetes.io~projected/kube-api-access-klbmp DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/13c02159515878d026b2b3d0aa437f3f0c2931607efefeaaf6c3a6f7bdeb578d/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a3c7e9ba0ddcc714fb8d78253b788883e798994ddaf1fe2be7256e71a3050bd4/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63792577-37e5-4fd1-9398-a3901b22b391/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:271 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f91247e1-6c15-4eb3-909c-4145e59ec71a/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:348 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c51ee834bf831df763d3677b0ef73c82586cf3d9814abeb36440be28a1c3c39d/userdata/shm DeviceMajor:0 DeviceMinor:358 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:360 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-462 DeviceMajor:0 DeviceMinor:462 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-536 DeviceMajor:0 DeviceMinor:536 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-541 DeviceMajor:0 DeviceMinor:541 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:306 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bd926117-3d33-4749-bb15-e44f4067a47d/volumes/kubernetes.io~projected/kube-api-access-4vsc4 DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~projected/kube-api-access-glrrr DeviceMajor:0 DeviceMinor:54 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:272 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/497b8e7d-4ec6-4aa0-bcb5-588889dff64b/volumes/kubernetes.io~projected/kube-api-access-xvwsz DeviceMajor:0 DeviceMinor:277 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/50a0b339-36a2-46de-a121-7399125b6d6f/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:450 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e6637eff0a2cd5edfded63efa87318ee3e727fb072d1949501dd06ade462bb4/userdata/shm DeviceMajor:0 DeviceMinor:456 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32a16558203367e31439823c1af48d0243f78dbad979c36220779747ff5f86a5/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/808d4a84a218b9fa5277261d133a2302b1d037c3174f5ce183048abe26313271/userdata/shm DeviceMajor:0 DeviceMinor:275 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:305 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:313 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3b271ee249cb356f09d135f019239955642f01cd2594aa90882db80de1e2521f/userdata/shm DeviceMajor:0 DeviceMinor:364 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-498 DeviceMajor:0 DeviceMinor:498 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e22d3ef-c49a-4941-baf7-18af20b42f64/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/904e4f55-1d16-4919-b398-15506d1c2e7c/volumes/kubernetes.io~projected/kube-api-access-9q24j DeviceMajor:0 DeviceMinor:225 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-470 DeviceMajor:0 DeviceMinor:470 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-508 DeviceMajor:0 DeviceMinor:508 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-532 DeviceMajor:0 DeviceMinor:532 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:3b271ee249cb356 MacAddress:c6:24:b0:e2:57:b0 Speed:10000 Mtu:8901} {Name:52954b4df8262e3 MacAddress:72:01:0a:08:ab:8a Speed:10000 Mtu:8901} {Name:688f2e18807f982 MacAddress:c2:f5:10:29:92:9a Speed:10000 Mtu:8901} {Name:6e6637eff0a2cd5 MacAddress:8a:51:9e:02:60:b3 Speed:10000 Mtu:8901} {Name:808d4a84a218b9f MacAddress:ce:f6:5d:1f:63:fc Speed:10000 Mtu:8901} {Name:8c194555397b63e MacAddress:7e:88:ef:60:52:51 Speed:10000 Mtu:8901} {Name:987cd61c069666d MacAddress:12:42:fd:f0:99:ac Speed:10000 Mtu:8901} {Name:98f808080a124a0 MacAddress:3e:79:a0:21:10:cb Speed:10000 Mtu:8901} {Name:a36c2f5f0160da3 MacAddress:86:92:6b:b6:33:be Speed:10000 Mtu:8901} {Name:a3c7e9ba0ddcc71 MacAddress:f2:75:93:45:f3:07 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:4b:a2:94:af:99 Speed:0 Mtu:9001} {Name:br-int MacAddress:22:cc:6d:e0:37:9a Speed:0 Mtu:8901} {Name:c51ee834bf831df MacAddress:5a:1b:04:06:d2:3c Speed:10000 Mtu:8901} {Name:d4f302fcb636774 MacAddress:76:eb:c5:12:48:36 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:4b:a2:94:af:99 Speed:0 Mtu:9001} {Name:f0e0d00b8f4a6d3 MacAddress:06:36:27:f4:5b:aa Speed:10000 Mtu:8901} {Name:f4bd1b11c75ae52 MacAddress:c6:34:7d:af:d3:cd Speed:10000 Mtu:8901} {Name:f9021a39414b1c9 MacAddress:b6:c2:d0:40:6f:69 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:f2:03:d5:89:03:e9 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:6a:b9:14:9c:e5:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:45:11.949857 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.949505    5967 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:45:11.949857 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.949553    5967 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:45:11.949959 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.949892    5967 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:45:11.950085 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.949928    5967 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-176.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:45:11.950166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950088    5967 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:45:11.950166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950101    5967 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:45:11.950166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950115    5967 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:45:11.950166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950143    5967 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:45:11.950324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950266    5967 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:45:11.950504 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950490    5967 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:45:11.950634 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950623    5967 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:45:11.950688 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950668    5967 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:45:11.950734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950688    5967 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:45:11.950734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950704    5967 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:45:11.950734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950717    5967 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:45:11.950734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.950728    5967 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:45:11.951466 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.951451    5967 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:45:11.951466 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.951465    5967 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:45:11.951999 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.951980    5967 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:45:11.955044 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955028    5967 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:45:11.955044 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955043    5967 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:45:11.955147 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955137    5967 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:45:11.955340 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955329    5967 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:45:11.955397 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955358    5967 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:45:11.955472 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955462    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955477    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955483    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955488    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955493    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955501    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:45:11.955511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955508    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955515    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955527    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955550    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955574    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955586    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955642    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:45:11.955674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.955648    5967 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:45:11.959067 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.959054    5967 server.go:1263] "Started kubelet"
Oct 30 21:45:11.959725 ip-10-0-130-176 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:45:11.959843 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.959803    5967 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:45:11.960483 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.959809    5967 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:45:11.960483 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.960429    5967 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:45:11.961027 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.960969    5967 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:45:11.964527 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.962537    5967 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966462    5967 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966476    5967 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966536    5967 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:39:00 +0000 UTC" deadline="2028-07-25 10:15:21.652781282 +0000 UTC"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966566    5967 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15204h30m9.686217735s"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966574    5967 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966586    5967 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:11.966600    5967 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:45:11.968259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.966686    5967 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:45:11.969045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969028    5967 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:45:11.969118 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969047    5967 factory.go:55] Registering systemd factory
Oct 30 21:45:11.969118 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969056    5967 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969450    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e22d3ef-c49a-4941-baf7-18af20b42f64" volumeName="kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969502    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081df627-1a6c-47d6-b63b-64ee0d0fbef8" volumeName="kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969508    5967 factory.go:153] Registering CRI-O factory
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969519    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50a0b339-36a2-46de-a121-7399125b6d6f" volumeName="kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969541    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969554    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06b42278-c848-4e19-8312-e235b5027b97" volumeName="kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969567    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969581    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969594    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50a0b339-36a2-46de-a121-7399125b6d6f" volumeName="kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969524    5967 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969608    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969621    5967 factory.go:103] Registering Raw factory
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969621    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969635    5967 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969634    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969647    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969660    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969673    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904e4f55-1d16-4919-b398-15506d1c2e7c" volumeName="kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969706    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969721    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cfa25fa1-62fb-44e6-a0de-1b885cea1c73" volumeName="kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969733    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f28179ea-90f6-4da2-a71d-ac889d8795b2" volumeName="kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969746    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c28eb9-feb7-44f1-ae79-32a241449056" volumeName="kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969757    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969771    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969797    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969812    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a62217-094a-4702-a1c1-f549178905ee" volumeName="kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969827    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969840    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30afacbf-8146-41aa-9298-672a74a30f81" volumeName="kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969855    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969868    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7ca3ec5-c805-4cf1-865a-eb0e1b337403" volumeName="kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969891    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081df627-1a6c-47d6-b63b-64ee0d0fbef8" volumeName="kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969905    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bdd0c58-d8d2-44f8-b848-f329c17cff43" volumeName="kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969922    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f28179ea-90f6-4da2-a71d-ac889d8795b2" volumeName="kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969934    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969947    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969956    5967 manager.go:319] Starting recovery of all containers
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969958    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904e4f55-1d16-4919-b398-15506d1c2e7c" volumeName="kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969971    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904e4f55-1d16-4919-b398-15506d1c2e7c" volumeName="kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969985    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd926117-3d33-4749-bb15-e44f4067a47d" volumeName="kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.969997    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970010    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30afacbf-8146-41aa-9298-672a74a30f81" volumeName="kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970022    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970035    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970047    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970059    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc" volumeName="kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970072    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d508c5ed-f2c6-4ea0-afb8-18afc8589ae7" volumeName="kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970091    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d508c5ed-f2c6-4ea0-afb8-18afc8589ae7" volumeName="kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970103    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970115    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c28eb9-feb7-44f1-ae79-32a241449056" volumeName="kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970128    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081df627-1a6c-47d6-b63b-64ee0d0fbef8" volumeName="kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970141    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bdd0c58-d8d2-44f8-b848-f329c17cff43" volumeName="kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970156    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8aa5ed76-7b28-4719-a111-512d990b5e70" volumeName="kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970168    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970181    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970193    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d53e9c7e-0933-40df-9112-c2422d49300a" volumeName="kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970207    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970220    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970231    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970246    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970258    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970270    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a62217-094a-4702-a1c1-f549178905ee" volumeName="kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970290    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d53e9c7e-0933-40df-9112-c2422d49300a" volumeName="kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970306    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970319    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bdd0c58-d8d2-44f8-b848-f329c17cff43" volumeName="kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970333    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970345    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970356    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8aa5ed76-7b28-4719-a111-512d990b5e70" volumeName="kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970385    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc" volumeName="kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970410    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970421    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e22d3ef-c49a-4941-baf7-18af20b42f64" volumeName="kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970465    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f28179ea-90f6-4da2-a71d-ac889d8795b2" volumeName="kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970480    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970492    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970504    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d508c5ed-f2c6-4ea0-afb8-18afc8589ae7" volumeName="kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970517    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970530    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c422a1f-05d8-4970-b87e-f2d5d5302cc0" volumeName="kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970542    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e22d3ef-c49a-4941-baf7-18af20b42f64" volumeName="kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970555    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970568    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970581    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970594    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970607    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c28eb9-feb7-44f1-ae79-32a241449056" volumeName="kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970620    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970635    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970648    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd926117-3d33-4749-bb15-e44f4067a47d" volumeName="kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970660    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c28eb9-feb7-44f1-ae79-32a241449056" volumeName="kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970678    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970692    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="648997b6-6ac2-41db-9d70-ced80bde4874" volumeName="kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970705    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a62217-094a-4702-a1c1-f549178905ee" volumeName="kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970718    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970731    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970748    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970762    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970774    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a62217-094a-4702-a1c1-f549178905ee" volumeName="kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970788    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970800    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970814    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970828    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970843    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970854    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081df627-1a6c-47d6-b63b-64ee0d0fbef8" volumeName="kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970867    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bdd0c58-d8d2-44f8-b848-f329c17cff43" volumeName="kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970879    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="636044d4-8f85-4a17-b555-83f2eae7b612" volumeName="kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970890    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7ca3ec5-c805-4cf1-865a-eb0e1b337403" volumeName="kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970902    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970916    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970928    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970938    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904e4f55-1d16-4919-b398-15506d1c2e7c" volumeName="kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970949    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" volumeName="kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970961    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970972    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970986    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.970997    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971009    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497b8e7d-4ec6-4aa0-bcb5-588889dff64b" volumeName="kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971022    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bdd0c58-d8d2-44f8-b848-f329c17cff43" volumeName="kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971033    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971046    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971058    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971087    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f91247e1-6c15-4eb3-909c-4145e59ec71a" volumeName="kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971098    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971110    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63792577-37e5-4fd1-9398-a3901b22b391" volumeName="kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971121    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed" volumeName="kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971133    5967 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f28179ea-90f6-4da2-a71d-ac889d8795b2" volumeName="kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7" seLinuxMountContext=""
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971147    5967 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:45:11.972160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:11.971155    5967 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:45:12.005017 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.004979    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:45:12.006924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.006892    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:45:12.008756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.008713    5967 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:45:12.010282 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.010261    5967 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:45:12.010410 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.010287    5967 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:45:12.010410 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.010316    5967 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:45:12.010410 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.010359    5967 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:45:12.026424 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.026362    5967 generic.go:356] "Generic (PLEG): container finished" podID="63792577-37e5-4fd1-9398-a3901b22b391" containerID="9e7dbad3ba9bd2c85c52aade07ce1acb62ca09a3f51cf23be00502dfc6c163ec" exitCode=0
Oct 30 21:45:12.034251 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.034232    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:45:12.034652 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.034626    5967 generic.go:356] "Generic (PLEG): container finished" podID="4bdd0c58-d8d2-44f8-b848-f329c17cff43" containerID="0f2138e96cddf685e3fdf1bf1059c7e3261b7237ba412f58d1304871c86f7a57" exitCode=1
Oct 30 21:45:12.052715 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.052677    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9" exitCode=0
Oct 30 21:45:12.060272 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060235    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="7050ea9e68ff39a3f77f869ac31d14415462928722aa66624b672b60b08cf602" exitCode=0
Oct 30 21:45:12.060272 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060266    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="c3dbc4d7ee7d4cc012247599b73c529feba8a52e87483870065627cf011c2f40" exitCode=0
Oct 30 21:45:12.060272 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060277    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="ed43b72f5d596c93f37d393d7852bac9ceed8a77dd2f9418d1115a236dcb0fe0" exitCode=0
Oct 30 21:45:12.060548 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060286    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="035f752d0e320cb012e586c84c790355341af14c00bf29c2111a2cbda7401ef0" exitCode=0
Oct 30 21:45:12.060548 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060295    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="7baf2c08583e93e465776bf9b1c680fbebd108e691af4e1baf25f685dc452e1d" exitCode=0
Oct 30 21:45:12.060548 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.060301    5967 generic.go:356] "Generic (PLEG): container finished" podID="f28179ea-90f6-4da2-a71d-ac889d8795b2" containerID="4735789732e1fcb5a7bf9930ce52330385b4592ccb5b3e74698ac8aef97c1ef0" exitCode=0
Oct 30 21:45:12.066763 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.066690    5967 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:45:12.070758 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.070712    5967 generic.go:356] "Generic (PLEG): container finished" podID="097b084259da656bcc2cdeca5dda5695" containerID="efd34bc224b3dc05187f7736ae6c41494b00ec070852997c25ca02b48b8959be" exitCode=0
Oct 30 21:45:12.082495 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.082463    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="be7b7be2a671f16fd197a104d68b95ce92ba965307867a7fde6b06f43ef4bb7e" exitCode=0
Oct 30 21:45:12.108945 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.108917    5967 manager.go:324] Recovery completed
Oct 30 21:45:12.110474 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.110447    5967 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 21:45:12.135728 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.135698    5967 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:45:12.137870 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.137852    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:45:12.137921 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.137886    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:45:12.137921 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.137896    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:45:12.143895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.143874    5967 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:45:12.143895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.143888    5967 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:45:12.144115 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.143902    5967 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:45:12.144115 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.143909    5967 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:45:12.144178 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144153    5967 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:45:12.144206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144166    5967 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:45:12.144206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144183    5967 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:45:12.144206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144189    5967 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:45:12.144206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144196    5967 policy_none.go:50] "Start"
Oct 30 21:45:12.144206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144206    5967 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:45:12.144350 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144219    5967 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:45:12.144400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144363    5967 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:45:12.144400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144389    5967 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:45:12.144400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.144396    5967 policy_none.go:44] "Start"
Oct 30 21:45:12.145083 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.145064    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:45:12.145177 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.145103    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:45:12.145177 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.145118    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:45:12.150462 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.150430    5967 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:45:12.154001 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.153985    5967 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:45:12.154125 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.154019    5967 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:45:12.154125 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154029    5967 server.go:87] "Starting device plugin registration server"
Oct 30 21:45:12.154336 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154324    5967 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:45:12.154411 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154336    5967 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:45:12.154544 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154532    5967 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:45:12.154645 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154620    5967 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:45:12.154700 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154651    5967 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:45:12.154700 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154658    5967 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:45:12.155843 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.154738    5967 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:45:12.154642902Z","UUID":"5a80f680-6ebf-4637-9536-cdb9c1e92629","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:45:12.156494 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.156473    5967 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:45:12.156585 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.156523    5967 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-176.us-west-1.compute.internal\" not found"
Oct 30 21:45:12.157330 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.157307    5967 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:45:12.157432 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.157343    5967 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:45:12.169635 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.169568    5967 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:45:12.169752 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.169737    5967 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:45:12.174711 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.174691    5967 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:45:12.211308 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.211287    5967 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:45:12.254910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.254880    5967 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:45:12.256091 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.256072    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:45:12.256187 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.256108    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:45:12.256187 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.256123    5967 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-176.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:45:12.256187 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.256186    5967 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.268738 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.268720    5967 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:45:12.311246 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.311204    5967 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"]
Oct 30 21:45:12.311923 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.311902    5967 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.312002 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.311935    5967 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.312002 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.311924    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"7ff8f2bfa49239d9e2240c708e676d72","Type":"ContainerStarted","Data":"b1c4d6309bc5f97d01829f64313db711113ac4ca342f9c399314afca587d0e48"}
Oct 30 21:45:12.312002 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.311986    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"7ff8f2bfa49239d9e2240c708e676d72","Type":"ContainerStarted","Data":"0c7ab0c73a99e8b2ee4611c826ab9da2598e415b6da455bdc89e307490d6960c"}
Oct 30 21:45:12.312102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.312047    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerStarted","Data":"cdebd9b5987bfac132a1472a80a37ba222b48d6ee3374ddcaeb5cdef7af2f673"}
Oct 30 21:45:12.312102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.312065    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerDied","Data":"efd34bc224b3dc05187f7736ae6c41494b00ec070852997c25ca02b48b8959be"}
Oct 30 21:45:12.312102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.312081    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal" event={"ID":"097b084259da656bcc2cdeca5dda5695","Type":"ContainerStarted","Data":"d7a3bfd1d86bd8eeb1f59e3851c38b9b0da01fc6acac69a1e64de9c9df472ce9"}
Oct 30 21:45:12.367598 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.367571    5967 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.367783 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.367644    5967 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.370761 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.370732    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.370885 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.370795    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.370885 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.370832    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.373196 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.373178    5967 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:45:12.373260 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.373222    5967 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.373818 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.373802    5967 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:45:12.373855 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:12.373843    5967 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471403    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471452    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471482    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471526    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471534    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b084259da656bcc2cdeca5dda5695-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"097b084259da656bcc2cdeca5dda5695\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.471618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.471532    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ff8f2bfa49239d9e2240c708e676d72-config\") pod \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" (UID: \"7ff8f2bfa49239d9e2240c708e676d72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:12.951278 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:12.951193    5967 apiserver.go:52] "Watching apiserver"
Oct 30 21:45:13.058498 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.058460    5967 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:45:13.059245 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.059213    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9cfb6c9d5-btlkb","openshift-monitoring/telemeter-client-679f8f864b-9b6s6","openshift-cluster-node-tuning-operator/tuned-mrmlw","kube-system/global-pull-secret-syncer-vmc55","openshift-monitoring/prometheus-k8s-0","openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n","openshift-monitoring/thanos-querier-7d9c499cc7-5mr27","openshift-monitoring/node-exporter-p9fg6","kube-system/konnectivity-agent-zfpxl","openshift-ingress-canary/ingress-canary-64t9j","openshift-monitoring/alertmanager-main-0","openshift-ovn-kubernetes/ovnkube-node-2nx9p","openshift-multus/multus-vghc6","openshift-dns/node-resolver-527lj","openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b","openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t","openshift-dns/dns-default-f2864","openshift-image-registry/node-ca-gnp7k","kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal","openshift-insights/insights-runtime-extractor-f4m64","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-dd45d","openshift-multus/network-metrics-daemon-rlsms","openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5","openshift-network-diagnostics/network-check-target-hg4h9","openshift-network-operator/iptables-alerter-wjcvf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"]
Oct 30 21:45:13.075643 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075607    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075658    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrrr\" (UniqueName: \"kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075685    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075708    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mzw\" (UniqueName: \"kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075731    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075753    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.075791 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075776    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075800    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075823    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcs7\" (UniqueName: \"kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075843    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075866    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075887    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2jg9\" (UniqueName: \"kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075907    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075928    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075949    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075970    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.075999    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076023    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076045    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076067    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.076160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076120    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076231    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4z2\" (UniqueName: \"kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076265    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/081df627-1a6c-47d6-b63b-64ee0d0fbef8-data-volume\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076473    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076502    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076526    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076550    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076578    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076673    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076756    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076796    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.076852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076829    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076906    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076934    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.076992    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077000    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-tmp\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077009    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077056    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q24j\" (UniqueName: \"kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077085    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077059    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53e9c7e-0933-40df-9112-c2422d49300a-tmp-dir\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077201    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077297    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.077324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077320    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077346    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgxzh\" (UniqueName: \"kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077383    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077410    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077427    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077462    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077478    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vsc4\" (UniqueName: \"kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077492    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077513    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077538    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077560    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077577    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.077668 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077602    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxfp\" (UniqueName: \"kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077679    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077700    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077715    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077730    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077749    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077761    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077782    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077802    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077814    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077828    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077847    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077864    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmn8t\" (UniqueName: \"kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077878    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077894    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:13.077976 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.077913    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078010    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078025    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078039    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078054    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078068    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078089    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078103    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078118    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5c7\" (UniqueName: \"kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078136    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078160    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klbmp\" (UniqueName: \"kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078177    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078192    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078209    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tqmf\" (UniqueName: \"kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078224    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078244    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078257    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078275    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078289    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078304    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078322    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:45:13.078351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078341    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078358    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078394    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078411    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078425    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078441    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078459    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078474    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078493    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078508    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078652    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfsp\" (UniqueName: \"kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078672    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078688    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078703    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078720    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078736    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078751    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.078903 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.078766    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:45:13.079537 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.079126    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a62217-094a-4702-a1c1-f549178905ee-tmp-dir\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.079537 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.079344    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-tuned\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.079537 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.079442    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-textfile\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.095503 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.095485    5967 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:13.095605 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.095591    5967 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:13.114625 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.114602    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:45:13.114969 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.114937    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s7wrh\""
Oct 30 21:45:13.115265 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115244    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:45:13.115329 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115286    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6ptf6\""
Oct 30 21:45:13.115329 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115295    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vv25x\""
Oct 30 21:45:13.115444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115352    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ph4bx\""
Oct 30 21:45:13.115494 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115446    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:45:13.115545 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115532    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2rr9\""
Oct 30 21:45:13.115627 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115613    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gmj65\""
Oct 30 21:45:13.115681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115664    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.115681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115668    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.115784 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115699    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:45:13.115784 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115723    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vv2h\""
Oct 30 21:45:13.115784 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115754    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:45:13.115867 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115842    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-22kpt\""
Oct 30 21:45:13.115924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115907    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.115973 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115915    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fqpcl\""
Oct 30 21:45:13.115973 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115936    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.115973 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115962    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115987    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hfjp\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115998    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116026    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.115988    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116083    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pc99\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116083    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:45:13.116104 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116103    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116236    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116242    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116261    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116264    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116286    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116302    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116303    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116304    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.116458 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116421    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.116769 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116466    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cni-binary-copy\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.116769 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.116523    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.117714 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.117698    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-daemon-config\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.117875 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.117863    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-original-pull-secret\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.120000 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.119982    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50a0b339-36a2-46de-a121-7399125b6d6f-metrics-certs\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:13.120000 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.119991    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.120114 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.119992    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.120152 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.120109    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30afacbf-8146-41aa-9298-672a74a30f81-konnectivity-ca\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:45:13.120152 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.120115    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd926117-3d33-4749-bb15-e44f4067a47d-iptables-alerter-script\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.120212 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.120170    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30afacbf-8146-41aa-9298-672a74a30f81-agent-certs\") pod \"konnectivity-agent-zfpxl\" (UID: \"30afacbf-8146-41aa-9298-672a74a30f81\") " pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:45:13.120540 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.120525    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-serviceca\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.126342 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.126327    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f28179ea-90f6-4da2-a71d-ac889d8795b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.162434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.162412    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:45:13.162511 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.162449    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.162670 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.162658    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:45:13.163734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.163721    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:45:13.164616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164601    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.164680 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164613    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:45:13.164680 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164660    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.164787 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164770    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:45:13.164833 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164777    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 21:45:13.164871 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164834    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.164911 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.164877    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.165108 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.165096    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:45:13.165141 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.165096    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:45:13.165271 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.165257    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:45:13.165602 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.165583    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 21:45:13.166305 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166275    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:45:13.166444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166396    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a62217-094a-4702-a1c1-f549178905ee-config-volume\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.166528 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166514    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:45:13.166623 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166608    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:45:13.166688 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166645    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 21:45:13.166846 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166822    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 21:45:13.166933 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166853    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 21:45:13.166933 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166874    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.166933 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166886    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 21:45:13.166933 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166915    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 21:45:13.167117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.166969    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 21:45:13.167117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167060    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 21:45:13.167117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167096    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:45:13.167117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167098    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:45:13.167239 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167121    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 21:45:13.167395 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167352    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:45:13.167476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167396    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:45:13.167476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167446    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 21:45:13.167476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167464    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:45:13.167476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167472    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h672v\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167475    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167496    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jxsgm\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167493    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167498    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167500    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lddw4\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167527    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167532    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 21:45:13.167681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.167567    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:45:13.168142 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168121    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ltjsw\""
Oct 30 21:45:13.168217 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168205    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mcz8h\""
Oct 30 21:45:13.168266 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168260    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:45:13.168321 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168311    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:45:13.168642 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168626    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 21:45:13.168720 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.168707    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:45:13.169105 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169087    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-cert\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:45:13.169156 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169144    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.169241 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169206    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-env-overrides\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.169412 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169392    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904e4f55-1d16-4919-b398-15506d1c2e7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.169466 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169427    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovn-node-metrics-cert\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.169516 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169489    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-config\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.169568 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169548    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bdd0c58-d8d2-44f8-b848-f329c17cff43-ovnkube-script-lib\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.169634 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169587    5967 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:45:13.169682 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.169641    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3a62217-094a-4702-a1c1-f549178905ee-metrics-tls\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.177338 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.177323    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/081df627-1a6c-47d6-b63b-64ee0d0fbef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.179632 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179613    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.179713 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179645    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.179713 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179671    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.179713 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179697    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhbc\" (UniqueName: \"kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179725    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179739    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-socket-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179750    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179781    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179787    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.179858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179812    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179876    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-socket-dir-parent\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179889    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179897    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179909    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179927    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179951    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179940    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-wtmp\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179876    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-sys\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.179977    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180001    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180003    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-hostroot\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180003    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180023    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-sys-fs\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180100    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180121    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180139    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180149    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180156    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180174    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180201    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180226    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180261    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180288    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-host\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180287    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180316    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180335    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180342    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-kubernetes\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180351    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180359    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180388    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180363    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-tls\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180410    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180426    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180429    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-kubelet-config\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180443    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180423    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8aa5ed76-7b28-4719-a111-512d990b5e70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180466    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180481    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-system-cni-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180495    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxx6b\" (UniqueName: \"kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180523    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180523    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-cnibin\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180543    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-cnibin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.180581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180574    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180605    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180636    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180663    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180699    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180667    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180725    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-multus\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180715    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-etc-kubernetes\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180752    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180773    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180782    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180797    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180802    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfa25fa1-62fb-44e6-a0de-1b885cea1c73-dbus\") pod \"global-pull-secret-syncer-vmc55\" (UID: \"cfa25fa1-62fb-44e6-a0de-1b885cea1c73\") " pod="kube-system/global-pull-secret-syncer-vmc55"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180826    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180856    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180901    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-netns\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180904    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180940    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180972    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.180998    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181029    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181052    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181054    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181097    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181103    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-ovn\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181096    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181118    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-sys\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181136    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwsz\" (UniqueName: \"kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181165    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181210    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181212    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181238    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181271    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-run\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181294    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-netns\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181294    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-host\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181315    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181358    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181358    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53e9c7e-0933-40df-9112-c2422d49300a-hosts-file\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181407    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181431    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/081df627-1a6c-47d6-b63b-64ee0d0fbef8-crio-socket\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181441    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181460    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181476    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181490    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181504    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181527    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-netd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181520    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181557    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-k8s-cni-cncf-io\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181573    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-device-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181589    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-cni-bin\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181606    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181625    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-kubelet\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181663    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181658    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-lib-modules\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181699    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181778    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181827    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181847    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181874    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181897    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181914    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181919    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-modprobe-d\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181930    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181948    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllr4\" (UniqueName: \"kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181963    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181978    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.181992    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-log-socket\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182040    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182086    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.182066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182120    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182139    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182160    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182165    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd926117-3d33-4749-bb15-e44f4067a47d-host-slash\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182171    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-var-lib-kubelet\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182176    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182201    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182221    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182230    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-audit-log\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182234    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182257    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182276    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pjrc\" (UniqueName: \"kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182297    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182311    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f28179ea-90f6-4da2-a71d-ac889d8795b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182322    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182346    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182351    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182408    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182412    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182453    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysconfig\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182452    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182489    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182506    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182523    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182538    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182553    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182570    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-sysctl-conf\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182599    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-systemd-units\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182605    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-multus-conf-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182612    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182607    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182636    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-cni-bin\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182650    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182674    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182694    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182739    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182731    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182775    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182787    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182804    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182815    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182835    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-run-multus-certs\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182826    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182860    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182862    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-node-log\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182885    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182905    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182906    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182931    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182955    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63792577-37e5-4fd1-9398-a3901b22b391-root\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.182968    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183067    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e22d3ef-c49a-4941-baf7-18af20b42f64-etc-systemd\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183116    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183126    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183146    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183166    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183165    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-var-lib-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183201    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67jsq\" (UniqueName: \"kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183215    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183235    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183260    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183278    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183293    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183323    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91247e1-6c15-4eb3-909c-4145e59ec71a-tmp\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183330    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183355    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183409    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183493    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-registration-dir\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.183507    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184193    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184203    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184315    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184497    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-secret-metrics-server-client-certs\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184597    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184607    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184633    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184660    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184684    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184701    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184723    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184744    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184764    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184783    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184800    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184820    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184844    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.184919    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185005    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-host-var-lib-kubelet\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.184991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185018    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-system-cni-dir\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185067    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-host-slash\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185099    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-run-systemd\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185236    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bdd0c58-d8d2-44f8-b848-f329c17cff43-etc-openvswitch\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185235    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.185533    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-metrics-server-audit-profiles\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.188709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.186564    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.211994 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.211936    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:45:13.211994 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.211941    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vwmgd\""
Oct 30 21:45:13.212454 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.212438    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 21:45:13.212454 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.212447    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 21:45:13.212543 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.212453    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 21:45:13.212711 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.212700    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hcpdk\""
Oct 30 21:45:13.212753 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.212745    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 21:45:13.213440 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.213422    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.213497 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.213484    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 21:45:13.213574 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.213544    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214051    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbmp\" (UniqueName: \"kubernetes.io/projected/8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc-kube-api-access-klbmp\") pod \"node-ca-gnp7k\" (UID: \"8b898dbb-6ac1-45f8-b6ea-1fae6400f4cc\") " pod="openshift-image-registry/node-ca-gnp7k"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214174    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxfp\" (UniqueName: \"kubernetes.io/projected/50a0b339-36a2-46de-a121-7399125b6d6f-kube-api-access-vrxfp\") pod \"network-metrics-daemon-rlsms\" (UID: \"50a0b339-36a2-46de-a121-7399125b6d6f\") " pod="openshift-multus/network-metrics-daemon-rlsms"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214192    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmn8t\" (UniqueName: \"kubernetes.io/projected/d53e9c7e-0933-40df-9112-c2422d49300a-kube-api-access-vmn8t\") pod \"node-resolver-527lj\" (UID: \"d53e9c7e-0933-40df-9112-c2422d49300a\") " pod="openshift-dns/node-resolver-527lj"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214216    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mzw\" (UniqueName: \"kubernetes.io/projected/63792577-37e5-4fd1-9398-a3901b22b391-kube-api-access-58mzw\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214231    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2jg9\" (UniqueName: \"kubernetes.io/projected/d508c5ed-f2c6-4ea0-afb8-18afc8589ae7-kube-api-access-c2jg9\") pod \"multus-vghc6\" (UID: \"d508c5ed-f2c6-4ea0-afb8-18afc8589ae7\") " pod="openshift-multus/multus-vghc6"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214265    5967 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214320    5967 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:13.214365    5967 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214463    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7g76\" (UniqueName: \"kubernetes.io/projected/06b42278-c848-4e19-8312-e235b5027b97-kube-api-access-t7g76\") pod \"network-check-target-hg4h9\" (UID: \"06b42278-c848-4e19-8312-e235b5027b97\") " pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214580    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vsc4\" (UniqueName: \"kubernetes.io/projected/bd926117-3d33-4749-bb15-e44f4067a47d-kube-api-access-4vsc4\") pod \"iptables-alerter-wjcvf\" (UID: \"bd926117-3d33-4749-bb15-e44f4067a47d\") " pod="openshift-network-operator/iptables-alerter-wjcvf"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:13.214636    5967 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214667    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q24j\" (UniqueName: \"kubernetes.io/projected/904e4f55-1d16-4919-b398-15506d1c2e7c-kube-api-access-9q24j\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214386    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcs7\" (UniqueName: \"kubernetes.io/projected/b3a62217-094a-4702-a1c1-f549178905ee-kube-api-access-hrcs7\") pod \"dns-default-f2864\" (UID: \"b3a62217-094a-4702-a1c1-f549178905ee\") " pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214769    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrrr\" (UniqueName: \"kubernetes.io/projected/9e22d3ef-c49a-4941-baf7-18af20b42f64-kube-api-access-glrrr\") pod \"tuned-mrmlw\" (UID: \"9e22d3ef-c49a-4941-baf7-18af20b42f64\") " pod="openshift-cluster-node-tuning-operator/tuned-mrmlw"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214838    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfsp\" (UniqueName: \"kubernetes.io/projected/9c422a1f-05d8-4970-b87e-f2d5d5302cc0-kube-api-access-vgfsp\") pod \"aws-ebs-csi-driver-node-xnjmp\" (UID: \"9c422a1f-05d8-4970-b87e-f2d5d5302cc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xnjmp"
Oct 30 21:45:13.214883 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214840    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5c7\" (UniqueName: \"kubernetes.io/projected/f28179ea-90f6-4da2-a71d-ac889d8795b2-kube-api-access-7b5c7\") pod \"multus-additional-cni-plugins-dd45d\" (UID: \"f28179ea-90f6-4da2-a71d-ac889d8795b2\") " pod="openshift-multus/multus-additional-cni-plugins-dd45d"
Oct 30 21:45:13.215500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.214901    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.215500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215088    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgxzh\" (UniqueName: \"kubernetes.io/projected/4bdd0c58-d8d2-44f8-b848-f329c17cff43-kube-api-access-hgxzh\") pod \"ovnkube-node-2nx9p\" (UID: \"4bdd0c58-d8d2-44f8-b848-f329c17cff43\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:13.215500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215293    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:45:13.215500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215386    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 21:45:13.215500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215499    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.215684 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215554    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:45:13.215684 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215565    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 21:45:13.215684 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215588    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 21:45:13.215684 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215588    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 21:45:13.215684 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215626    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:45:13.215895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215840    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 21:45:13.215895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215869    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 21:45:13.215895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215876    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:45:13.215895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215889    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215909    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215928    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjn2k\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215912    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215871    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215956    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkrw6\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215965    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vzpnp\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215967    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7g595\""
Oct 30 21:45:13.216056 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.215996    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216135    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tqhcl\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216175    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5001o2490p8s5\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216181    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gf2b7\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216204    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ulvdr33ekapg\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216237    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:45:13.216335 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216247    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8t5hsba9p2lg0\""
Oct 30 21:45:13.216608 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.216349    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n4tdx\""
Oct 30 21:45:13.217062 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.217047    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 21:45:13.217680 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.217660    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.217754 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.217725    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-metrics-client-ca\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.219902 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.219887    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-tls\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.219950 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.219898    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904e4f55-1d16-4919-b398-15506d1c2e7c-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-k8m2t\" (UID: \"904e4f55-1d16-4919-b398-15506d1c2e7c\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-k8m2t"
Oct 30 21:45:13.219950 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.219900    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63792577-37e5-4fd1-9398-a3901b22b391-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9fg6\" (UID: \"63792577-37e5-4fd1-9398-a3901b22b391\") " pod="openshift-monitoring/node-exporter-p9fg6"
Oct 30 21:45:13.220028 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.219972    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.221171 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221095    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.221171 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221107    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/648997b6-6ac2-41db-9d70-ced80bde4874-federate-client-tls\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.221171 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221122    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.221171 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221159    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221175    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221186    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221223    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221237    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221296    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221318    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221344    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.221434 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.221350    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.222428 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222405    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.222534 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222449    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.222534 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222481    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07c28eb9-feb7-44f1-ae79-32a241449056-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.222534 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222487    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-metrics-client-ca\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.222534 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222500    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.222653 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222534    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648997b6-6ac2-41db-9d70-ced80bde4874-serving-certs-ca-bundle\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.222653 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.222557    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91247e1-6c15-4eb3-909c-4145e59ec71a-metrics-client-ca\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.223694 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223668    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.223760 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223709    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.223760 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223712    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c28eb9-feb7-44f1-ae79-32a241449056-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.223845 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223755    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91247e1-6c15-4eb3-909c-4145e59ec71a-secret-grpc-tls\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.223845 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223761    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-client-ca-bundle\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.223958 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.223944    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4z2\" (UniqueName: \"kubernetes.io/projected/081df627-1a6c-47d6-b63b-64ee0d0fbef8-kube-api-access-kj4z2\") pod \"insights-runtime-extractor-f4m64\" (UID: \"081df627-1a6c-47d6-b63b-64ee0d0fbef8\") " pod="openshift-insights/insights-runtime-extractor-f4m64"
Oct 30 21:45:13.224060 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.224046    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tqmf\" (UniqueName: \"kubernetes.io/projected/a7ca3ec5-c805-4cf1-865a-eb0e1b337403-kube-api-access-5tqmf\") pod \"ingress-canary-64t9j\" (UID: \"a7ca3ec5-c805-4cf1-865a-eb0e1b337403\") " pod="openshift-ingress-canary/ingress-canary-64t9j"
Oct 30 21:45:13.226005 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.225987    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.239179 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.239156    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhbc\" (UniqueName: \"kubernetes.io/projected/648997b6-6ac2-41db-9d70-ced80bde4874-kube-api-access-hfhbc\") pod \"telemeter-client-679f8f864b-9b6s6\" (UID: \"648997b6-6ac2-41db-9d70-ced80bde4874\") " pod="openshift-monitoring/telemeter-client-679f8f864b-9b6s6"
Oct 30 21:45:13.239244 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.239186    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxx6b\" (UniqueName: \"kubernetes.io/projected/f91247e1-6c15-4eb3-909c-4145e59ec71a-kube-api-access-hxx6b\") pod \"thanos-querier-7d9c499cc7-5mr27\" (UID: \"f91247e1-6c15-4eb3-909c-4145e59ec71a\") " pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:13.239632 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.239603    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwsz\" (UniqueName: \"kubernetes.io/projected/497b8e7d-4ec6-4aa0-bcb5-588889dff64b-kube-api-access-xvwsz\") pod \"kube-state-metrics-5dc8d7d89b-2qz7n\" (UID: \"497b8e7d-4ec6-4aa0-bcb5-588889dff64b\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-2qz7n"
Oct 30 21:45:13.240219 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.240205    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllr4\" (UniqueName: \"kubernetes.io/projected/07c28eb9-feb7-44f1-ae79-32a241449056-kube-api-access-zllr4\") pod \"openshift-state-metrics-7bd7489957-h95d5\" (UID: \"07c28eb9-feb7-44f1-ae79-32a241449056\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-h95d5"
Oct 30 21:45:13.240500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.240485    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pjrc\" (UniqueName: \"kubernetes.io/projected/8aa5ed76-7b28-4719-a111-512d990b5e70-kube-api-access-7pjrc\") pod \"monitoring-plugin-77f4f76594-pxl8b\" (UID: \"8aa5ed76-7b28-4719-a111-512d990b5e70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:13.242317 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.242295    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67jsq\" (UniqueName: \"kubernetes.io/projected/64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed-kube-api-access-67jsq\") pod \"metrics-server-9cfb6c9d5-btlkb\" (UID: \"64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed\") " pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:13.242702 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.242688    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"prometheus-k8s-0\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:13.243905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.243890    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"alertmanager-main-0\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:13.377338 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:13.377309    5967 scope.go:122] "RemoveContainer" containerID="ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"
Oct 30 21:45:14.103417 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:14.103364    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerStarted","Data":"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"}
Oct 30 21:45:14.103873 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:14.103462    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerStarted","Data":"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"}
Oct 30 21:45:15.126681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:15.126646    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f2864"
Oct 30 21:45:15.773516 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:15.773480    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:15.893979 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:15.893948    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:16.715910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:16.715875    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:16.720258 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:16.720234    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pxl8b"
Oct 30 21:45:17.000380 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:17.000288    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:17.000549 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:17.000540    5967 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:45:17.021325 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:17.021287    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:17.437730 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:17.437644    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:18.174176 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:18.174139    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:18.178421 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:18.178394    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d9c499cc7-5mr27"
Oct 30 21:45:20.203969 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:20.203938    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:20.204477 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:20.204223    5967 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:45:22.544663 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:22.544588    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nx9p"
Oct 30 21:45:23.195379 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:23.195353    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:45:28.309174 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:28.309147    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:45:30.903708 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:30.903678    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfpxl"
Oct 30 21:45:33.046116 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046061    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:33.046660 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046443    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="alertmanager" containerID="cri-o://64db679655b6b38e73d2093617ca84a308e2629461d672c420873b79923b9f66" gracePeriod=120
Oct 30 21:45:33.046859 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046825    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-metric" containerID="cri-o://fd43e47fb83887efc515653ec307a2923ced68765f8bfad72a6947f7e8af63ad" gracePeriod=120
Oct 30 21:45:33.046859 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046822    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy" containerID="cri-o://1388c0c627f8c13d4dcdc3337e251fdf5a7f11e6c665bdf22b146b07b9e615c6" gracePeriod=120
Oct 30 21:45:33.047078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046857    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-web" containerID="cri-o://c2b6f11c78b483c90327b2bbee839e5f7734c53bc5deafe398caa6b080451bec" gracePeriod=120
Oct 30 21:45:33.047078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046796    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="prom-label-proxy" containerID="cri-o://ae277f9a846d5b09391b604d91f3c2ba81f1a1ca7de5ce541ffec90ecd924a81" gracePeriod=120
Oct 30 21:45:33.047078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.046825    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="config-reloader" containerID="cri-o://3f97cdca009e1668d48935db6c838d4f76f6b74ca9757e5adcd13b626b110f12" gracePeriod=120
Oct 30 21:45:33.183545 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183519    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="ae277f9a846d5b09391b604d91f3c2ba81f1a1ca7de5ce541ffec90ecd924a81" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183547    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="fd43e47fb83887efc515653ec307a2923ced68765f8bfad72a6947f7e8af63ad" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183560    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="1388c0c627f8c13d4dcdc3337e251fdf5a7f11e6c665bdf22b146b07b9e615c6" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183569    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="c2b6f11c78b483c90327b2bbee839e5f7734c53bc5deafe398caa6b080451bec" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183575    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="3f97cdca009e1668d48935db6c838d4f76f6b74ca9757e5adcd13b626b110f12" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183581    5967 generic.go:356] "Generic (PLEG): container finished" podID="636044d4-8f85-4a17-b555-83f2eae7b612" containerID="64db679655b6b38e73d2093617ca84a308e2629461d672c420873b79923b9f66" exitCode=0
Oct 30 21:45:33.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183594    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"ae277f9a846d5b09391b604d91f3c2ba81f1a1ca7de5ce541ffec90ecd924a81"}
Oct 30 21:45:33.184009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183712    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"fd43e47fb83887efc515653ec307a2923ced68765f8bfad72a6947f7e8af63ad"}
Oct 30 21:45:33.184009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183759    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"1388c0c627f8c13d4dcdc3337e251fdf5a7f11e6c665bdf22b146b07b9e615c6"}
Oct 30 21:45:33.184009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183800    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"c2b6f11c78b483c90327b2bbee839e5f7734c53bc5deafe398caa6b080451bec"}
Oct 30 21:45:33.184009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183840    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"3f97cdca009e1668d48935db6c838d4f76f6b74ca9757e5adcd13b626b110f12"}
Oct 30 21:45:33.184009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.183878    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"64db679655b6b38e73d2093617ca84a308e2629461d672c420873b79923b9f66"}
Oct 30 21:45:33.345203 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.345175    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:33.464502 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464467    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464520    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464540    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464564    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464617    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464638    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.464685 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464669    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464696    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464716    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464744    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464777    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464811    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.464847    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") pod \"636044d4-8f85-4a17-b555-83f2eae7b612\" (UID: \"636044d4-8f85-4a17-b555-83f2eae7b612\") "
Oct 30 21:45:33.465866 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.465831    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:33.466329 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.466296    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:33.466773 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.466735    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:33.468192 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468167    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.468310 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468259    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "kube-api-access-8wq2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:33.468629 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468604    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.468824 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468796    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:33.468824 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468803    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.468959 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468884    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.469016 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.468946    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:33.469091 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.469075    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.472852 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.472833    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.480862 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.480839    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config" pod "636044d4-8f85-4a17-b555-83f2eae7b612" (UID: "636044d4-8f85-4a17-b555-83f2eae7b612"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:33.566471 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566399    5967 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-cluster-tls-config\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566471 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566449    5967 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-web-config\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566471 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566459    5967 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-tls-assets\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566471 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566470    5967 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566480    5967 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-main-db\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566489    5967 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566498    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-metrics-client-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566508    5967 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636044d4-8f85-4a17-b555-83f2eae7b612-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566518    5967 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-config-volume\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566526    5967 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566535    5967 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/636044d4-8f85-4a17-b555-83f2eae7b612-config-out\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566543    5967 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/636044d4-8f85-4a17-b555-83f2eae7b612-secret-alertmanager-main-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:33.566692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:33.566551    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wq2k\" (UniqueName: \"kubernetes.io/projected/636044d4-8f85-4a17-b555-83f2eae7b612-kube-api-access-8wq2k\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:34.191041 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.191002    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"636044d4-8f85-4a17-b555-83f2eae7b612","Type":"ContainerDied","Data":"f0e0d00b8f4a6d39d14d124472b4e77a00ce0e5870e1af200beaf831ac306a12"}
Oct 30 21:45:34.191522 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.191065    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.191522 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.191093    5967 scope.go:122] "RemoveContainer" containerID="ae277f9a846d5b09391b604d91f3c2ba81f1a1ca7de5ce541ffec90ecd924a81"
Oct 30 21:45:34.201083 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.201059    5967 scope.go:122] "RemoveContainer" containerID="fd43e47fb83887efc515653ec307a2923ced68765f8bfad72a6947f7e8af63ad"
Oct 30 21:45:34.209245 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.209226    5967 scope.go:122] "RemoveContainer" containerID="1388c0c627f8c13d4dcdc3337e251fdf5a7f11e6c665bdf22b146b07b9e615c6"
Oct 30 21:45:34.216952 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.216932    5967 scope.go:122] "RemoveContainer" containerID="c2b6f11c78b483c90327b2bbee839e5f7734c53bc5deafe398caa6b080451bec"
Oct 30 21:45:34.224738 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.224703    5967 scope.go:122] "RemoveContainer" containerID="3f97cdca009e1668d48935db6c838d4f76f6b74ca9757e5adcd13b626b110f12"
Oct 30 21:45:34.232564 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.232544    5967 scope.go:122] "RemoveContainer" containerID="64db679655b6b38e73d2093617ca84a308e2629461d672c420873b79923b9f66"
Oct 30 21:45:34.240864 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.240839    5967 scope.go:122] "RemoveContainer" containerID="be7b7be2a671f16fd197a104d68b95ce92ba965307867a7fde6b06f43ef4bb7e"
Oct 30 21:45:34.358541 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.358462    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:34.408722 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.408691    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:34.409225 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409206    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:34.409572 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409555    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="alertmanager"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409575    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="alertmanager"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409589    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-metric"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409597    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-metric"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409626    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="config-reloader"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409636    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="config-reloader"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409645    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409652    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy"
Oct 30 21:45:34.409664 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409661    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="init-config-reloader"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409669    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="init-config-reloader"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409688    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="prom-label-proxy"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409696    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="prom-label-proxy"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409720    5967 cpu_manager.go:414] "containerMap: removing container" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-web"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409727    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-web"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409827    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="config-reloader"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409839    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409847    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="init-config-reloader"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409858    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="prom-label-proxy"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409871    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-web"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409881    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="alertmanager"
Oct 30 21:45:34.410045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.409889    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" containerName="kube-rbac-proxy-metric"
Oct 30 21:45:34.436160 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.436135    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.489097 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489068    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 21:45:34.489248 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489115    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 21:45:34.489615 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489599    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 21:45:34.489683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489603    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 21:45:34.489683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489629    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hcpdk\""
Oct 30 21:45:34.489683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489637    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 21:45:34.489683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489648    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 21:45:34.489683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489680    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 21:45:34.489857 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.489682    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 21:45:34.539190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.539167    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 21:45:34.540677 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.540649    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:34.575832 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.575802    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.575990 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.575839    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.575990 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.575859    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.575990 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.575885    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576106 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576048    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-web-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576106 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576075    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-out\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576107    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576206 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576131    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576320 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576301    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576384 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576340    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576433 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576361    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgq5\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-kube-api-access-wqgq5\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576499 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576479    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.576543 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.576517    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677124 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677043    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677124 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677085    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677124 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677104    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgq5\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-kube-api-access-wqgq5\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677124 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677121    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677515 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677140    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677515 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677161    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677515 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677415    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677515 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677454    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677515 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677490    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677525    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-web-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677559    5967 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:45:34.677756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677658    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-out\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677712    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.677756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.677738    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.678227 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.678154    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.678227 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.678228    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.678816 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.678765    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.680842 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.680794    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-out\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.680842 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.680833    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681012 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.680916    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681446 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.681424    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681582 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.681426    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681582 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.681529    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681582 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.681577    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.681736 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.681650    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-web-config\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.682325 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.682308    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.739127 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.739099    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgq5\" (UniqueName: \"kubernetes.io/projected/03a6147e-6b1e-4715-a9c4-28319b6e4b4c-kube-api-access-wqgq5\") pod \"alertmanager-main-0\" (UID: \"03a6147e-6b1e-4715-a9c4-28319b6e4b4c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:34.869452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:34.869421    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 21:45:35.376528 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:35.376497    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 21:45:35.380048 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:45:35.380019    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a6147e_6b1e_4715_a9c4_28319b6e4b4c.slice/crio-bb0a41afa2a99a02555ab30bb7e70d55129b9dc3727c22b3bd9c5f2c97fc27f9 WatchSource:0}: Error finding container bb0a41afa2a99a02555ab30bb7e70d55129b9dc3727c22b3bd9c5f2c97fc27f9: Status 404 returned error can't find the container with id bb0a41afa2a99a02555ab30bb7e70d55129b9dc3727c22b3bd9c5f2c97fc27f9
Oct 30 21:45:35.592694 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:45:35.592661    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:45:35.778574 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:35.778544    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:35.782351 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:35.782327    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9cfb6c9d5-btlkb"
Oct 30 21:45:36.016895 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:36.016854    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="636044d4-8f85-4a17-b555-83f2eae7b612" path="/var/lib/kubelet/pods/636044d4-8f85-4a17-b555-83f2eae7b612/volumes"
Oct 30 21:45:36.202102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:36.202066    5967 generic.go:356] "Generic (PLEG): container finished" podID="03a6147e-6b1e-4715-a9c4-28319b6e4b4c" containerID="443f7404dce42d0456adf9e845f0afc83b0d06f6cc71d0e4bd107d056c4860b0" exitCode=0
Oct 30 21:45:36.202295 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:36.202147    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerDied","Data":"443f7404dce42d0456adf9e845f0afc83b0d06f6cc71d0e4bd107d056c4860b0"}
Oct 30 21:45:36.202295 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:36.202275    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"bb0a41afa2a99a02555ab30bb7e70d55129b9dc3727c22b3bd9c5f2c97fc27f9"}
Oct 30 21:45:37.210024 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.209992    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"de0c132e4413c2f47fd9424ab7dc97073f5919d7853b1c1c522c4b98070720c3"}
Oct 30 21:45:37.210452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.210085    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"c2e98b21c24ad9aab6413cd85f41efaa3e66b28c366bfb8fd2506ae552ec3dac"}
Oct 30 21:45:37.210452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.210126    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"67a99fd6a20b8f3193b5403af605ae9e954f81a602c832ce1e2eb8b700e85526"}
Oct 30 21:45:37.210452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.210156    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"4ea20f109f464757d04f282676e889b934aad48ff0c96b62471eff13207b511c"}
Oct 30 21:45:37.210452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.210178    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"5701caeb83c2d50f06d2981bfa38c58d4efea146cf66bb358af2a4da8c177516"}
Oct 30 21:45:37.210452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.210220    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03a6147e-6b1e-4715-a9c4-28319b6e4b4c","Type":"ContainerStarted","Data":"aa3d31d8e904f4cb5cada7d26c33acf902f4aeb23498c9439178473c22444d3f"}
Oct 30 21:45:37.342493 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:37.342441    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.335173631 podStartE2EDuration="3.342427168s" totalImagesPullingTime="0s" totalInitContainerRuntime="7.253537ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:37.341123783 +0000 UTC m=+25.455832134" watchObservedRunningTime="2026-10-30 21:45:37.342427168 +0000 UTC m=+25.457135535"
Oct 30 21:45:38.753420 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753383    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:45:38.753833 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753782    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="prometheus" containerID="cri-o://8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7" gracePeriod=600
Oct 30 21:45:38.753901 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753829    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7" gracePeriod=600
Oct 30 21:45:38.753901 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753886    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy" containerID="cri-o://6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f" gracePeriod=600
Oct 30 21:45:38.754003 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753864    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="thanos-sidecar" containerID="cri-o://9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3" gracePeriod=600
Oct 30 21:45:38.754003 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753842    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-web" containerID="cri-o://149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52" gracePeriod=600
Oct 30 21:45:38.754087 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:38.753872    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="config-reloader" containerID="cri-o://8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb" gracePeriod=600
Oct 30 21:45:39.221702 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221668    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7" exitCode=0
Oct 30 21:45:39.221702 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221691    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f" exitCode=0
Oct 30 21:45:39.221702 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221698    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52" exitCode=0
Oct 30 21:45:39.221702 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221707    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3" exitCode=0
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221712    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb" exitCode=0
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221718    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7" exitCode=0
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221741    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"}
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221805    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"}
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221834    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52"}
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221858    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3"}
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221889    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb"}
Oct 30 21:45:39.221937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:39.221914    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7"}
Oct 30 21:45:43.197786 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:45:43.197754    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hg4h9"
Oct 30 21:46:05.590131 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:46:05.590092    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:46:35.590695 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:46:35.590655    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:47:05.591674 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:05.591636    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:47:35.591991 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:35.591951    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:47:37.112522 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.112500    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/kube-rbac-proxy/0.log"
Oct 30 21:47:37.115108 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.115089    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.212930 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.212897    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.212930 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.212933    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.212962    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.212997    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213027    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213059    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213092    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213129 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213120    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213153    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213180    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213207    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213256    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213323    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213358    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213404    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213444 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213429    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213452    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213457    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213504    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213531    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213552    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213560    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") pod \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\" (UID: \"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd\") "
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213563    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213699    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213733    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.213836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213775    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213875    5967 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-metrics-client-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213896    5967 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213911    5967 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-db\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213928    5967 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213944    5967 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.214524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.213961    5967 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.215119 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.215030    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.217331 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.216958    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:37.217331 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.217099    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.218827 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.218730    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.218955 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.218921    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:47:37.219023 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.218983    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.219521 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219474    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.219608 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219517    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "kube-api-access-jw5q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:37.219732 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219705    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.219867 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219760    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:37.219867 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219828    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.219984 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.219905    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.220284 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.220250    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.231088 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.231049    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config" pod "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" (UID: "2d61ed8f-d2c8-41d3-bed6-24f0376c52cd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314523    5967 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314550    5967 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314566    5967 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-grpc-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314579    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw5q9\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-kube-api-access-jw5q9\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314589    5967 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-metrics-client-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314597    5967 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-tls-assets\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314600 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314607    5967 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-web-config\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314615    5967 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-kube-rbac-proxy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314623    5967 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314632    5967 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314641    5967 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-config-out\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314650    5967 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314658    5967 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.314905 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.314668    5967 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.646063 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.645989    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/kube-rbac-proxy/0.log"
Oct 30 21:47:37.647566 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.647534    5967 generic.go:356] "Generic (PLEG): container finished" podID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerID="ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c" exitCode=137
Oct 30 21:47:37.647650 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.647590    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"}
Oct 30 21:47:37.647650 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.647629    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.647717 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.647658    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d61ed8f-d2c8-41d3-bed6-24f0376c52cd","Type":"ContainerDied","Data":"f4bd1b11c75ae52e4cb3f98971f6f74138d45c4203d14f5d068ea12327fe77ce"}
Oct 30 21:47:37.647717 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.647692    5967 scope.go:122] "RemoveContainer" containerID="facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"
Oct 30 21:47:37.661086 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.660990    5967 scope.go:122] "RemoveContainer" containerID="6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"
Oct 30 21:47:37.668276 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.668258    5967 scope.go:122] "RemoveContainer" containerID="ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"
Oct 30 21:47:37.674945 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.674933    5967 scope.go:122] "RemoveContainer" containerID="149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52"
Oct 30 21:47:37.681353 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.681336    5967 scope.go:122] "RemoveContainer" containerID="9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3"
Oct 30 21:47:37.687838 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.687819    5967 scope.go:122] "RemoveContainer" containerID="8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb"
Oct 30 21:47:37.694991 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.694973    5967 scope.go:122] "RemoveContainer" containerID="8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7"
Oct 30 21:47:37.702710 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.702692    5967 scope.go:122] "RemoveContainer" containerID="99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9"
Oct 30 21:47:37.709303 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.709284    5967 scope.go:122] "RemoveContainer" containerID="facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"
Oct 30 21:47:37.709645 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.709624    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7\": container with ID starting with facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7 not found: ID does not exist" containerID="facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"
Oct 30 21:47:37.709711 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.709659    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7"} err="failed to get container status \"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7\": rpc error: code = NotFound desc = could not find container \"facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7\": container with ID starting with facf6f01c51af2ae966b5bc9951471fa404fc268b78a89c68b98b84ca827b4b7 not found: ID does not exist"
Oct 30 21:47:37.709711 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.709693    5967 scope.go:122] "RemoveContainer" containerID="6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"
Oct 30 21:47:37.709932 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.709915    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f\": container with ID starting with 6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f not found: ID does not exist" containerID="6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"
Oct 30 21:47:37.709984 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.709939    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f"} err="failed to get container status \"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f\": rpc error: code = NotFound desc = could not find container \"6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f\": container with ID starting with 6af6d34d9edcb818cf87e8ce230270008948c4809b74df481907d03322a29e9f not found: ID does not exist"
Oct 30 21:47:37.709984 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.709955    5967 scope.go:122] "RemoveContainer" containerID="ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"
Oct 30 21:47:37.710177 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.710163    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c\": container with ID starting with ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c not found: ID does not exist" containerID="ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"
Oct 30 21:47:37.710221 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710180    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c"} err="failed to get container status \"ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c\": rpc error: code = NotFound desc = could not find container \"ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c\": container with ID starting with ce513f6b38e15d6ff1ef4927671cc22a33decc24b4474884552b55b4a6eb348c not found: ID does not exist"
Oct 30 21:47:37.710221 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710194    5967 scope.go:122] "RemoveContainer" containerID="149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52"
Oct 30 21:47:37.710451 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.710434    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52\": container with ID starting with 149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52 not found: ID does not exist" containerID="149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52"
Oct 30 21:47:37.710542 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710453    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52"} err="failed to get container status \"149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52\": rpc error: code = NotFound desc = could not find container \"149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52\": container with ID starting with 149fed8b7fef2d26036c1c4a4f5a934dccea58b4b933a323f38560d331c24c52 not found: ID does not exist"
Oct 30 21:47:37.710542 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710469    5967 scope.go:122] "RemoveContainer" containerID="9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3"
Oct 30 21:47:37.710726 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.710710    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3\": container with ID starting with 9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3 not found: ID does not exist" containerID="9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3"
Oct 30 21:47:37.710767 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710731    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3"} err="failed to get container status \"9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3\": rpc error: code = NotFound desc = could not find container \"9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3\": container with ID starting with 9938a15d248aca6e631204f735f4dc8dc4bb280cedebe9ef083178f1396f75b3 not found: ID does not exist"
Oct 30 21:47:37.710767 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710749    5967 scope.go:122] "RemoveContainer" containerID="8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb"
Oct 30 21:47:37.710967 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.710950    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb\": container with ID starting with 8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb not found: ID does not exist" containerID="8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb"
Oct 30 21:47:37.711014 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710972    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb"} err="failed to get container status \"8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb\": rpc error: code = NotFound desc = could not find container \"8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb\": container with ID starting with 8bcc0b03bea737042b33f27f86e5bcc562363271b3c8da9c3b104f76cbed7dbb not found: ID does not exist"
Oct 30 21:47:37.711014 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.710986    5967 scope.go:122] "RemoveContainer" containerID="8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7"
Oct 30 21:47:37.711205 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.711191    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7\": container with ID starting with 8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7 not found: ID does not exist" containerID="8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7"
Oct 30 21:47:37.711248 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.711208    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7"} err="failed to get container status \"8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7\": rpc error: code = NotFound desc = could not find container \"8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7\": container with ID starting with 8d6be9a0f755f45735bb553145fef8953f5f7245d276efb5d39ebaa7413ccff7 not found: ID does not exist"
Oct 30 21:47:37.711248 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.711226    5967 scope.go:122] "RemoveContainer" containerID="99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9"
Oct 30 21:47:37.711722 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:47:37.711705    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9\": container with ID starting with 99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9 not found: ID does not exist" containerID="99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9"
Oct 30 21:47:37.711813 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.711725    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9"} err="failed to get container status \"99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9\": rpc error: code = NotFound desc = could not find container \"99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9\": container with ID starting with 99746e4ff2364880bdd3463a50a5f5d07045d7002ba7233d96cd8a483b64a7e9 not found: ID does not exist"
Oct 30 21:47:37.816362 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.816333    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:47:37.866297 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.866261    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:47:37.866890 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.866864    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:47:37.867185 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867171    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="init-config-reloader"
Oct 30 21:47:37.867226 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867187    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="init-config-reloader"
Oct 30 21:47:37.867226 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867213    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-web"
Oct 30 21:47:37.867226 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867220    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-web"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867229    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="prometheus"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867238    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="prometheus"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867259    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="config-reloader"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867264    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="config-reloader"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867272    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-thanos"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867277    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-thanos"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867290    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867294    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867300    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867305    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867310    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="thanos-sidecar"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867315    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="thanos-sidecar"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867358    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-web"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867380    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="prometheus"
Oct 30 21:47:37.867355 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867387    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="config-reloader"
Oct 30 21:47:37.867834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867393    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy-thanos"
Oct 30 21:47:37.867834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867400    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867405    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="kube-rbac-proxy"
Oct 30 21:47:37.867834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.867409    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" containerName="thanos-sidecar"
Oct 30 21:47:37.870945 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.870926    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920660 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920597    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920660 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920629    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920660 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920657    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920774    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920806    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920823    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920927 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920907    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.920961 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920931    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6nfp\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-kube-api-access-p6nfp\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921013 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.920996    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921051 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921034    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921059    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921112    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921134 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921128    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921229 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921146    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921229 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921163    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921404 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921245    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921404 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921280    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921404 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921314    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921404 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921343    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.921588 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.921419    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:37.924274 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924244    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:47:37.924274 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924266    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:47:37.924427 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924302    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:47:37.924427 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924255    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:47:37.924427 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924394    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924481    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924489    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924485    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924525    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924532    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924532    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4ulvdr33ekapg\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924548    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:47:37.924576 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924577    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mcz8h\""
Oct 30 21:47:37.924880 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.924728    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:47:37.974639 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.974605    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:47:37.974810 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.974695    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:47:37.990497 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:37.990469    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:47:38.015707 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.015676    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d61ed8f-d2c8-41d3-bed6-24f0376c52cd" path="/var/lib/kubelet/pods/2d61ed8f-d2c8-41d3-bed6-24f0376c52cd/volumes"
Oct 30 21:47:38.023438 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023411    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023591 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023449    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023591 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023475    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023699 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023652    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023745 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023710    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023812 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023742    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023812 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023770    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023906 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023825    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023906 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023852    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6nfp\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-kube-api-access-p6nfp\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.023906 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023892    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023934    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.023967    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024096    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024165    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024186    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024202    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024219    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024266    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024300    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.024491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.024328    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.025233 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.025206    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.026536 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.026507    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027388 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.026799    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027388 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.026824    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027388 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.027191    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027388 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.027289    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027637 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.027411    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a2f429-c5d6-4242-b470-ff85899d6027-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027637 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.027612    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.027925 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.027903    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028489 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028106    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028489 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028105    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028489 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028318    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028489 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028452    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028720 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028712    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a2f429-c5d6-4242-b470-ff85899d6027-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.028916 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.028896    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.029777 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.029755    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-config\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.030096 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.030077    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.030441 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.030426    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.031091 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.031077    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a2f429-c5d6-4242-b470-ff85899d6027-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.085560 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.085536    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6nfp\" (UniqueName: \"kubernetes.io/projected/f3a2f429-c5d6-4242-b470-ff85899d6027-kube-api-access-p6nfp\") pod \"prometheus-k8s-0\" (UID: \"f3a2f429-c5d6-4242-b470-ff85899d6027\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.186846 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.186759    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:47:38.617520 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.617488    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:47:38.621233 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:47:38.621206    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a2f429_c5d6_4242_b470_ff85899d6027.slice/crio-de5d480ade015ddd144af9a154d138474f4f83331eb3fa7a8eba266f3efad625 WatchSource:0}: Error finding container de5d480ade015ddd144af9a154d138474f4f83331eb3fa7a8eba266f3efad625: Status 404 returned error can't find the container with id de5d480ade015ddd144af9a154d138474f4f83331eb3fa7a8eba266f3efad625
Oct 30 21:47:38.652548 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:38.652527    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"de5d480ade015ddd144af9a154d138474f4f83331eb3fa7a8eba266f3efad625"}
Oct 30 21:47:39.657737 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:39.657705    5967 generic.go:356] "Generic (PLEG): container finished" podID="f3a2f429-c5d6-4242-b470-ff85899d6027" containerID="0b49fec6ef9f77eec8153b6c3ea7a9e78ffae501fa18615431283c2cd0dcd4f1" exitCode=0
Oct 30 21:47:39.658121 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:39.657781    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerDied","Data":"0b49fec6ef9f77eec8153b6c3ea7a9e78ffae501fa18615431283c2cd0dcd4f1"}
Oct 30 21:47:40.665712 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665683    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"05cd4ead2bcc5406a48a53c9b647a6b68652de1f0ece2b6f7deac6f93182bcc4"}
Oct 30 21:47:40.666146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665744    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"f9fa607e720e991225ef915e103879c70ca0ca66d5b1f9301f6923c87c63b759"}
Oct 30 21:47:40.666146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665770    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"3e4a24353d0b76e1885ba0109f9e63d1f6ae1b4f7e59ea09775f8a1559bebefe"}
Oct 30 21:47:40.666146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665793    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"6eb2fb7d1ea217d4b32a26caa6c771b1b45b024d4d7c7cea663e135fc8d1c311"}
Oct 30 21:47:40.666146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665817    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"c05bb178a5f822864edd1a15655d6bdff70fcb661a771994414f0d0d3d874f49"}
Oct 30 21:47:40.666146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.665841    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a2f429-c5d6-4242-b470-ff85899d6027","Type":"ContainerStarted","Data":"740712e2fe65eb33f1485d9a9cf2951eccc02c013304d5646ea2107b152d16ca"}
Oct 30 21:47:40.797979 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:40.797925    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.782755915 podStartE2EDuration="3.797905971s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.150056ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:40.797180688 +0000 UTC m=+148.911889039" watchObservedRunningTime="2026-10-30 21:47:40.797905971 +0000 UTC m=+148.912614329"
Oct 30 21:47:43.187808 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:47:43.187779    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:48:05.592096 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:48:05.592055    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:48:35.591605 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:48:35.591559    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:48:38.187235 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:48:38.187207    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:48:38.203312 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:48:38.203291    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:48:38.900722 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:48:38.900697    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:49:05.591062 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:49:05.591026    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:49:35.590794 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:49:35.590754    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:50:05.591000 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:50:05.590964    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:50:07.628660 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:50:07.628616    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podUID="7ff8f2bfa49239d9e2240c708e676d72" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 30 21:50:12.034159 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:50:12.034127    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:50:12.036494 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:50:12.036468    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:50:35.592137 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:50:35.592100    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:51:05.591196 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:51:05.591155    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:51:27.382514 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.382474    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"]
Oct 30 21:51:27.385908 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.385893    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.432422 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.432399    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"]
Oct 30 21:51:27.473540 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473503    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.473540 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473539    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.473788 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473575    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2rl4\" (UniqueName: \"kubernetes.io/projected/aeac940d-30f7-4439-82a3-6e56904b4c96-kube-api-access-k2rl4\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.473788 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473644    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.473788 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473775    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.473937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.473815    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.474480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474431    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-ftnxp\""
Oct 30 21:51:27.474480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474446    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:51:27.474480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474453    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:51:27.474480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474446    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:51:27.474692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474512    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:51:27.474692 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.474577    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:51:27.574732 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574697    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.574924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574739    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.574924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574764    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.574924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574844    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.574924 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574871    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.575127 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.574923    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rl4\" (UniqueName: \"kubernetes.io/projected/aeac940d-30f7-4439-82a3-6e56904b4c96-kube-api-access-k2rl4\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.575271 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.575240    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.577449 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.577426    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.577549 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.577484    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.577603 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.577557    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeac940d-30f7-4439-82a3-6e56904b4c96-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.577776 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.577760    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aeac940d-30f7-4439-82a3-6e56904b4c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.636739 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.636672    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rl4\" (UniqueName: \"kubernetes.io/projected/aeac940d-30f7-4439-82a3-6e56904b4c96-kube-api-access-k2rl4\") pod \"opendatahub-operator-controller-manager-68c9746c4b-6sk5j\" (UID: \"aeac940d-30f7-4439-82a3-6e56904b4c96\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:27.700875 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:27.700837    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:28.199328 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:28.199295    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"]
Oct 30 21:51:28.202361 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:51:28.202332    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeac940d_30f7_4439_82a3_6e56904b4c96.slice/crio-b9f0bb2c2a68d5e1c0fc02a9f3844fab9ef32c81a42dc8bae7033dd5ac716a9b WatchSource:0}: Error finding container b9f0bb2c2a68d5e1c0fc02a9f3844fab9ef32c81a42dc8bae7033dd5ac716a9b: Status 404 returned error can't find the container with id b9f0bb2c2a68d5e1c0fc02a9f3844fab9ef32c81a42dc8bae7033dd5ac716a9b
Oct 30 21:51:28.203981 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:28.203957    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:51:28.493275 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:28.493243    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j" event={"ID":"aeac940d-30f7-4439-82a3-6e56904b4c96","Type":"ContainerStarted","Data":"b9f0bb2c2a68d5e1c0fc02a9f3844fab9ef32c81a42dc8bae7033dd5ac716a9b"}
Oct 30 21:51:32.511734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:32.511698    5967 generic.go:356] "Generic (PLEG): container finished" podID="aeac940d-30f7-4439-82a3-6e56904b4c96" containerID="302e0948cea494e6b4718f309305cb83808b743cea71ecee346a232150a07405" exitCode=0
Oct 30 21:51:32.512196 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:32.511785    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j" event={"ID":"aeac940d-30f7-4439-82a3-6e56904b4c96","Type":"ContainerDied","Data":"302e0948cea494e6b4718f309305cb83808b743cea71ecee346a232150a07405"}
Oct 30 21:51:33.517508 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:33.517476    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j" event={"ID":"aeac940d-30f7-4439-82a3-6e56904b4c96","Type":"ContainerStarted","Data":"1f93343ed6011efeeecad18f512ba41e8c6ccb78ffb3a0ade31db534c43eadd0"}
Oct 30 21:51:33.517921 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:33.517558    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:33.757927 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:33.757870    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j" podStartSLOduration=2.143931699 podStartE2EDuration="6.757852472s" totalImagesPullingTime="4.138033873s" totalInitContainerRuntime="475.8869ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:33.708532275 +0000 UTC m=+381.823240626" watchObservedRunningTime="2026-10-30 21:51:33.757852472 +0000 UTC m=+381.872560824"
Oct 30 21:51:35.591565 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:51:35.591528    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:51:36.023550 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.023524    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"]
Oct 30 21:51:36.026920 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.026904    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.049920 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.049895    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqpbt\" (UniqueName: \"kubernetes.io/projected/85b69e60-9a62-4d79-9087-bd0b8735ce29-kube-api-access-gqpbt\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.050049 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.049928    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85b69e60-9a62-4d79-9087-bd0b8735ce29-tmp\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.084229 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.084207    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-wlf2w\""
Oct 30 21:51:36.134152 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.134118    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:51:36.134403 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.134162    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 21:51:36.135065 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.135040    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"]
Oct 30 21:51:36.151039 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.151015    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqpbt\" (UniqueName: \"kubernetes.io/projected/85b69e60-9a62-4d79-9087-bd0b8735ce29-kube-api-access-gqpbt\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.151156 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.151057    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85b69e60-9a62-4d79-9087-bd0b8735ce29-tmp\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.151477 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.151462    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85b69e60-9a62-4d79-9087-bd0b8735ce29-tmp\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.237438 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.237409    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqpbt\" (UniqueName: \"kubernetes.io/projected/85b69e60-9a62-4d79-9087-bd0b8735ce29-kube-api-access-gqpbt\") pod \"jobset-operator-674cd59dc5-68rxj\" (UID: \"85b69e60-9a62-4d79-9087-bd0b8735ce29\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.252740 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.252717    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"]
Oct 30 21:51:36.255998 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.255982    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.307981 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.307923    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 21:51:36.308177 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.308165    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 21:51:36.314601 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.314574    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"]
Oct 30 21:51:36.349738 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.349716    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"
Oct 30 21:51:36.352227 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.352196    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.352337 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.352266    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47n5n\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-kube-api-access-47n5n\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.453007 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.452977    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47n5n\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-kube-api-access-47n5n\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.453166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.453072    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.514102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.514076    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.514245 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.514207    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47n5n\" (UniqueName: \"kubernetes.io/projected/b38079a8-a336-4e83-95ec-5cfa41517470-kube-api-access-47n5n\") pod \"cert-manager-webhook-5dbbbf75cc-krl2p\" (UID: \"b38079a8-a336-4e83-95ec-5cfa41517470\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.567637 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.567572    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:36.722650 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.722617    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj"]
Oct 30 21:51:36.725978 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:51:36.725951    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85b69e60_9a62_4d79_9087_bd0b8735ce29.slice/crio-771da64f92d339819075ca867a1e2814a98e6e63466a73279f3bcc511dae39b5 WatchSource:0}: Error finding container 771da64f92d339819075ca867a1e2814a98e6e63466a73279f3bcc511dae39b5: Status 404 returned error can't find the container with id 771da64f92d339819075ca867a1e2814a98e6e63466a73279f3bcc511dae39b5
Oct 30 21:51:36.938295 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:36.938226    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"]
Oct 30 21:51:36.941664 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:51:36.941642    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb38079a8_a336_4e83_95ec_5cfa41517470.slice/crio-7960006bbf1c8921ddb841c9b83630e5ee00883ff03846bee43efe6d90d54a1e WatchSource:0}: Error finding container 7960006bbf1c8921ddb841c9b83630e5ee00883ff03846bee43efe6d90d54a1e: Status 404 returned error can't find the container with id 7960006bbf1c8921ddb841c9b83630e5ee00883ff03846bee43efe6d90d54a1e
Oct 30 21:51:37.534689 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:37.534655    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj" event={"ID":"85b69e60-9a62-4d79-9087-bd0b8735ce29","Type":"ContainerStarted","Data":"771da64f92d339819075ca867a1e2814a98e6e63466a73279f3bcc511dae39b5"}
Oct 30 21:51:37.535855 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:37.535832    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p" event={"ID":"b38079a8-a336-4e83-95ec-5cfa41517470","Type":"ContainerStarted","Data":"7960006bbf1c8921ddb841c9b83630e5ee00883ff03846bee43efe6d90d54a1e"}
Oct 30 21:51:41.557491 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:41.557451    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj" event={"ID":"85b69e60-9a62-4d79-9087-bd0b8735ce29","Type":"ContainerStarted","Data":"88b1f5b0fa52f63be5e748bb023e205ffba4035bea98e35d877f8fd7ceb12dcd"}
Oct 30 21:51:42.563776 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:42.563738    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p" event={"ID":"b38079a8-a336-4e83-95ec-5cfa41517470","Type":"ContainerStarted","Data":"07375d0ce8be8c2d08c9866d40b289780bcf761adb678fd0fee0f0c376a87ce0"}
Oct 30 21:51:42.564215 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:42.563965    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:51:42.680502 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:42.680426    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-68rxj" podStartSLOduration=3.094799307 podStartE2EDuration="7.680353551s" totalImagesPullingTime="4.585554244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:41.676888022 +0000 UTC m=+389.791596374" watchObservedRunningTime="2026-10-30 21:51:42.680353551 +0000 UTC m=+390.795061905"
Oct 30 21:51:42.680800 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:42.680769    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p" podStartSLOduration=1.741479659 podStartE2EDuration="6.68075976s" totalImagesPullingTime="4.939280101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:42.679854149 +0000 UTC m=+390.794562500" watchObservedRunningTime="2026-10-30 21:51:42.68075976 +0000 UTC m=+390.795468110"
Oct 30 21:51:44.523923 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:44.523894    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-6sk5j"
Oct 30 21:51:46.166834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.166792    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-l6nhv"]
Oct 30 21:51:46.172829 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.172809    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.229647 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.229611    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-l6nhv"]
Oct 30 21:51:46.244952 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.244929    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mrjx\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-kube-api-access-4mrjx\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.245119 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.244976    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-bound-sa-token\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.278000 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.277971    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rnrc8\""
Oct 30 21:51:46.346117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.346087    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mrjx\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-kube-api-access-4mrjx\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.346256 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.346136    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-bound-sa-token\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.410537 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.410495    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-bound-sa-token\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.412343 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.412317    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mrjx\" (UniqueName: \"kubernetes.io/projected/5be40618-9f37-4cb2-80fa-2dd8bca7e7e9-kube-api-access-4mrjx\") pod \"cert-manager-597b95cb84-l6nhv\" (UID: \"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9\") " pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.482803 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.482780    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-l6nhv"
Oct 30 21:51:46.887243 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:46.887170    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-l6nhv"]
Oct 30 21:51:46.890573 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:51:46.890551    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5be40618_9f37_4cb2_80fa_2dd8bca7e7e9.slice/crio-2cca3a66ba4cccb87d103cb1e6b7353246cc7a83f9a6756c464ef556b19b2353 WatchSource:0}: Error finding container 2cca3a66ba4cccb87d103cb1e6b7353246cc7a83f9a6756c464ef556b19b2353: Status 404 returned error can't find the container with id 2cca3a66ba4cccb87d103cb1e6b7353246cc7a83f9a6756c464ef556b19b2353
Oct 30 21:51:47.587476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:47.587439    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-l6nhv" event={"ID":"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9","Type":"ContainerStarted","Data":"d797df0a322236b88f8b2aedf9dd0f7745f6acb69fde9fb60d9e7a4af23ceebb"}
Oct 30 21:51:47.587866 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:47.587483    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-l6nhv" event={"ID":"5be40618-9f37-4cb2-80fa-2dd8bca7e7e9","Type":"ContainerStarted","Data":"2cca3a66ba4cccb87d103cb1e6b7353246cc7a83f9a6756c464ef556b19b2353"}
Oct 30 21:51:47.707406 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:47.707339    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-l6nhv" podStartSLOduration=1.707323819 podStartE2EDuration="1.707323819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:47.706763245 +0000 UTC m=+395.821471583" watchObservedRunningTime="2026-10-30 21:51:47.707323819 +0000 UTC m=+395.822032174"
Oct 30 21:51:48.571416 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:51:48.571361    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p"
Oct 30 21:52:05.590722 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:52:05.590676    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:52:08.121674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.121642    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"]
Oct 30 21:52:08.125196 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.125177    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.177918 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.177882    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 21:52:08.178166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.178150    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:52:08.227797 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.227764    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kwpp9\""
Oct 30 21:52:08.228896 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.228868    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"]
Oct 30 21:52:08.250542 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.250515    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2rb\" (UniqueName: \"kubernetes.io/projected/392751d1-2a25-4062-ae65-f9db9a9d8b6d-kube-api-access-nq2rb\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.250651 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.250602    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/392751d1-2a25-4062-ae65-f9db9a9d8b6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.250770 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.250750    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/392751d1-2a25-4062-ae65-f9db9a9d8b6d-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.278376 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.278349    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 21:52:08.278580 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.278562    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:52:08.351432 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.351404    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/392751d1-2a25-4062-ae65-f9db9a9d8b6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.351580 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.351485    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/392751d1-2a25-4062-ae65-f9db9a9d8b6d-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.351580 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.351542    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2rb\" (UniqueName: \"kubernetes.io/projected/392751d1-2a25-4062-ae65-f9db9a9d8b6d-kube-api-access-nq2rb\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.352109 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.352092    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/392751d1-2a25-4062-ae65-f9db9a9d8b6d-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.353920 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.353900    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/392751d1-2a25-4062-ae65-f9db9a9d8b6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.415412 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.415329    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2rb\" (UniqueName: \"kubernetes.io/projected/392751d1-2a25-4062-ae65-f9db9a9d8b6d-kube-api-access-nq2rb\") pod \"kuadrant-console-plugin-66c4fb575d-46x5b\" (UID: \"392751d1-2a25-4062-ae65-f9db9a9d8b6d\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.437213 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.437179    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"
Oct 30 21:52:08.808363 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:08.808325    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b"]
Oct 30 21:52:08.813022 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:52:08.812995    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod392751d1_2a25_4062_ae65_f9db9a9d8b6d.slice/crio-d9c0d150e39f50aec51f9903b3ebee62cff12e53353c95f0ef673f928bf92379 WatchSource:0}: Error finding container d9c0d150e39f50aec51f9903b3ebee62cff12e53353c95f0ef673f928bf92379: Status 404 returned error can't find the container with id d9c0d150e39f50aec51f9903b3ebee62cff12e53353c95f0ef673f928bf92379
Oct 30 21:52:09.685031 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:09.685002    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b" event={"ID":"392751d1-2a25-4062-ae65-f9db9a9d8b6d","Type":"ContainerStarted","Data":"d9c0d150e39f50aec51f9903b3ebee62cff12e53353c95f0ef673f928bf92379"}
Oct 30 21:52:14.713745 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:14.713710    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b" event={"ID":"392751d1-2a25-4062-ae65-f9db9a9d8b6d","Type":"ContainerStarted","Data":"0553d8d27701dc7e50107668504959fde0c2b0e6708e0117950f5c8937459f13"}
Oct 30 21:52:14.833488 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:14.833357    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-46x5b" podStartSLOduration=1.152137544 podStartE2EDuration="6.833343659s" totalImagesPullingTime="5.681206115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:14.831934321 +0000 UTC m=+422.946642701" watchObservedRunningTime="2026-10-30 21:52:14.833343659 +0000 UTC m=+422.948052008"
Oct 30 21:52:15.075245 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.075213    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"]
Oct 30 21:52:15.079036 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.079011    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.140116 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.140088    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:52:15.140332 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.140317    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:52:15.146318 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.146295    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"]
Oct 30 21:52:15.223707 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223673    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7q88\" (UniqueName: \"kubernetes.io/projected/fc85c551-4494-4a9e-869b-eeb851123427-kube-api-access-r7q88\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.223910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223722    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 21:52:15.223910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223747    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 21:52:15.223910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223812    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9v7w9\""
Oct 30 21:52:15.223910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223813    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc85c551-4494-4a9e-869b-eeb851123427-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.223910 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.223879    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc85c551-4494-4a9e-869b-eeb851123427-tmp\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.324648 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.324617    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc85c551-4494-4a9e-869b-eeb851123427-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.324816 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.324659    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc85c551-4494-4a9e-869b-eeb851123427-tmp\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.324816 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.324750    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7q88\" (UniqueName: \"kubernetes.io/projected/fc85c551-4494-4a9e-869b-eeb851123427-kube-api-access-r7q88\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.327210 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.327181    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc85c551-4494-4a9e-869b-eeb851123427-tmp\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.327429 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.327413    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc85c551-4494-4a9e-869b-eeb851123427-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.423525 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.423469    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7q88\" (UniqueName: \"kubernetes.io/projected/fc85c551-4494-4a9e-869b-eeb851123427-kube-api-access-r7q88\") pod \"kube-auth-proxy-54874bdfcc-dzfxr\" (UID: \"fc85c551-4494-4a9e-869b-eeb851123427\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:15.693844 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:15.693759    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"
Oct 30 21:52:16.126731 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.126700    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr"]
Oct 30 21:52:16.129760 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:52:16.129735    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc85c551_4494_4a9e_869b_eeb851123427.slice/crio-10b5d601fd977d33fdfe3b0fb79fa750131d574c93aae9175257dda5cb8f11d7 WatchSource:0}: Error finding container 10b5d601fd977d33fdfe3b0fb79fa750131d574c93aae9175257dda5cb8f11d7: Status 404 returned error can't find the container with id 10b5d601fd977d33fdfe3b0fb79fa750131d574c93aae9175257dda5cb8f11d7
Oct 30 21:52:16.428159 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.428086    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:16.459250 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.459222    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:16.499337 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.499312    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:16.519947 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.519925    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vd4rq\""
Oct 30 21:52:16.635873 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.635848    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6h9\" (UniqueName: \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\") pod \"authorino-57f7f8659f-45b98\" (UID: \"6f82031b-1129-445a-8636-12fc145ea518\") " pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:16.731331 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.731303    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr" event={"ID":"fc85c551-4494-4a9e-869b-eeb851123427","Type":"ContainerStarted","Data":"10b5d601fd977d33fdfe3b0fb79fa750131d574c93aae9175257dda5cb8f11d7"}
Oct 30 21:52:16.736754 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.736732    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6h9\" (UniqueName: \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\") pod \"authorino-57f7f8659f-45b98\" (UID: \"6f82031b-1129-445a-8636-12fc145ea518\") " pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:16.803097 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:16.803072    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6h9\" (UniqueName: \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\") pod \"authorino-57f7f8659f-45b98\" (UID: \"6f82031b-1129-445a-8636-12fc145ea518\") " pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:17.089715 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:17.089636    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:17.506563 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:17.506419    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:17.510166 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:52:17.510081    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f82031b_1129_445a_8636_12fc145ea518.slice/crio-02af6736ec186187f4e5653e65e67aa68eba82827f082939d9b29e1dab259d72 WatchSource:0}: Error finding container 02af6736ec186187f4e5653e65e67aa68eba82827f082939d9b29e1dab259d72: Status 404 returned error can't find the container with id 02af6736ec186187f4e5653e65e67aa68eba82827f082939d9b29e1dab259d72
Oct 30 21:52:17.739575 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:17.739535    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-45b98" event={"ID":"6f82031b-1129-445a-8636-12fc145ea518","Type":"ContainerStarted","Data":"02af6736ec186187f4e5653e65e67aa68eba82827f082939d9b29e1dab259d72"}
Oct 30 21:52:18.582266 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.582234    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"]
Oct 30 21:52:18.589162 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.588924    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.644521 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.644478    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 30 21:52:18.654334 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.654295    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-metrics-certs\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.654541 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.654347    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2cm\" (UniqueName: \"kubernetes.io/projected/647b260c-90c5-425c-8cc6-62e73c643475-kube-api-access-gk2cm\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.654541 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.654525    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/647b260c-90c5-425c-8cc6-62e73c643475-manager-config\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.654667 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.654630    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-cert\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.694501 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.694470    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-g9q4n\""
Oct 30 21:52:18.694501 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.694473    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 30 21:52:18.694704 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.694516    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 30 21:52:18.695512 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.695494    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"]
Oct 30 21:52:18.755673 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.755645    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-cert\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.755844 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.755689    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-metrics-certs\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.755844 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.755709    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2cm\" (UniqueName: \"kubernetes.io/projected/647b260c-90c5-425c-8cc6-62e73c643475-kube-api-access-gk2cm\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.755844 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.755755    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/647b260c-90c5-425c-8cc6-62e73c643475-manager-config\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.756561 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.756538    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/647b260c-90c5-425c-8cc6-62e73c643475-manager-config\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.758512 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.758477    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-metrics-certs\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.758512 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.758491    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/647b260c-90c5-425c-8cc6-62e73c643475-cert\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.817601 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.817572    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2cm\" (UniqueName: \"kubernetes.io/projected/647b260c-90c5-425c-8cc6-62e73c643475-kube-api-access-gk2cm\") pod \"jobset-controller-manager-6c5877cbcc-fdwk6\" (UID: \"647b260c-90c5-425c-8cc6-62e73c643475\") " pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:18.909502 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:18.909426    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:19.291972 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:19.291939    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"]
Oct 30 21:52:19.297742 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:52:19.297708    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647b260c_90c5_425c_8cc6_62e73c643475.slice/crio-5f4236adef89f44ecd155d04a177e7e4db49f3aa8623990d20e8f3af0b2f2343 WatchSource:0}: Error finding container 5f4236adef89f44ecd155d04a177e7e4db49f3aa8623990d20e8f3af0b2f2343: Status 404 returned error can't find the container with id 5f4236adef89f44ecd155d04a177e7e4db49f3aa8623990d20e8f3af0b2f2343
Oct 30 21:52:19.751098 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:19.751059    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr" event={"ID":"fc85c551-4494-4a9e-869b-eeb851123427","Type":"ContainerStarted","Data":"9b4fdbaa06f2256137f721cdbf093d7d001b124e7b1810b7e8f64bc141a763ec"}
Oct 30 21:52:19.753723 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:19.753643    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6" event={"ID":"647b260c-90c5-425c-8cc6-62e73c643475","Type":"ContainerStarted","Data":"5f4236adef89f44ecd155d04a177e7e4db49f3aa8623990d20e8f3af0b2f2343"}
Oct 30 21:52:19.868706 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:19.868546    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-dzfxr" podStartSLOduration=1.9153074970000001 podStartE2EDuration="4.868528882s" totalImagesPullingTime="2.953221385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:19.868204008 +0000 UTC m=+427.982912359" watchObservedRunningTime="2026-10-30 21:52:19.868528882 +0000 UTC m=+427.983237230"
Oct 30 21:52:21.765772 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:21.765733    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-45b98" event={"ID":"6f82031b-1129-445a-8636-12fc145ea518","Type":"ContainerStarted","Data":"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"}
Oct 30 21:52:21.879703 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:21.879639    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-45b98" podStartSLOduration=2.321934966 podStartE2EDuration="5.879620397s" totalImagesPullingTime="3.557685431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:21.879231673 +0000 UTC m=+429.993940032" watchObservedRunningTime="2026-10-30 21:52:21.879620397 +0000 UTC m=+429.994328749"
Oct 30 21:52:24.079399 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.079338    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:24.079871 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.079551    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-45b98" podUID="6f82031b-1129-445a-8636-12fc145ea518" containerName="authorino" containerID="cri-o://c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605" gracePeriod=30
Oct 30 21:52:24.411574 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.411550    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:24.512755 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.512717    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\" (UniqueName: \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\") pod \"6f82031b-1129-445a-8636-12fc145ea518\" (UID: \"6f82031b-1129-445a-8636-12fc145ea518\") "
Oct 30 21:52:24.515180 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.515154    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9" pod "6f82031b-1129-445a-8636-12fc145ea518" (UID: "6f82031b-1129-445a-8636-12fc145ea518"). InnerVolumeSpecName "kube-api-access-zp6h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:52:24.614040 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.613957    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp6h9\" (UniqueName: \"kubernetes.io/projected/6f82031b-1129-445a-8636-12fc145ea518-kube-api-access-zp6h9\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:52:24.782922 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.782880    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6" event={"ID":"647b260c-90c5-425c-8cc6-62e73c643475","Type":"ContainerStarted","Data":"e088b69ee75085851453d751fa2229b86230d7a9bbeadf851290f0044e3f1f7b"}
Oct 30 21:52:24.783127 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.782960    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:52:24.784070 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.784045    5967 generic.go:356] "Generic (PLEG): container finished" podID="6f82031b-1129-445a-8636-12fc145ea518" containerID="c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605" exitCode=0
Oct 30 21:52:24.784199 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.784080    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-45b98" event={"ID":"6f82031b-1129-445a-8636-12fc145ea518","Type":"ContainerDied","Data":"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"}
Oct 30 21:52:24.784199 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.784091    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-45b98"
Oct 30 21:52:24.784199 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.784100    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-45b98" event={"ID":"6f82031b-1129-445a-8636-12fc145ea518","Type":"ContainerDied","Data":"02af6736ec186187f4e5653e65e67aa68eba82827f082939d9b29e1dab259d72"}
Oct 30 21:52:24.784199 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.784115    5967 scope.go:122] "RemoveContainer" containerID="c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"
Oct 30 21:52:24.795916 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.795888    5967 scope.go:122] "RemoveContainer" containerID="c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"
Oct 30 21:52:24.796654 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:52:24.796623    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605\": container with ID starting with c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605 not found: ID does not exist" containerID="c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"
Oct 30 21:52:24.796776 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.796664    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605"} err="failed to get container status \"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605\": rpc error: code = NotFound desc = could not find container \"c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605\": container with ID starting with c88bc7fc2451b316801d84cc0e8a43f032c0ad7b4ddb291da4de3b884688a605 not found: ID does not exist"
Oct 30 21:52:24.899974 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:24.899873    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6" podStartSLOduration=1.882558601 podStartE2EDuration="6.899858626s" totalImagesPullingTime="5.017300025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:24.89913684 +0000 UTC m=+433.013845211" watchObservedRunningTime="2026-10-30 21:52:24.899858626 +0000 UTC m=+433.014566976"
Oct 30 21:52:25.009519 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:25.009486    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:25.013659 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:25.013634    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-45b98"]
Oct 30 21:52:26.017179 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:26.017143    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f82031b-1129-445a-8636-12fc145ea518" path="/var/lib/kubelet/pods/6f82031b-1129-445a-8636-12fc145ea518/volumes"
Oct 30 21:52:35.591657 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:52:35.591623    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:52:35.794850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:52:35.794821    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-6c5877cbcc-fdwk6"
Oct 30 21:53:05.591967 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:53:05.591928    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:53:35.591167 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:53:35.591125    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:53:46.973530 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:46.973485    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"]
Oct 30 21:53:46.974023 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:46.974000    5967 cpu_manager.go:414] "containerMap: removing container" podUID="6f82031b-1129-445a-8636-12fc145ea518" containerName="authorino"
Oct 30 21:53:46.974023 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:46.974021    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f82031b-1129-445a-8636-12fc145ea518" containerName="authorino"
Oct 30 21:53:46.974221 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:46.974091    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f82031b-1129-445a-8636-12fc145ea518" containerName="authorino"
Oct 30 21:53:46.976866 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:46.976850    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.030828 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.030799    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-hpwhb\""
Oct 30 21:53:47.080686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.080648    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 21:53:47.080686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.080648    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 21:53:47.080686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.080657    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:53:47.080686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.080670    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:53:47.081022 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.080712    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 21:53:47.081917 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.081896    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"]
Oct 30 21:53:47.136218 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.136184    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.136393 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.136232    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf2zk\" (UniqueName: \"kubernetes.io/projected/59b6b65e-95b4-4075-9719-f30f7adbdf44-kube-api-access-lf2zk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.136438 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.136386    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59b6b65e-95b4-4075-9719-f30f7adbdf44-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.136438 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.136429    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.237244 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.237164    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf2zk\" (UniqueName: \"kubernetes.io/projected/59b6b65e-95b4-4075-9719-f30f7adbdf44-kube-api-access-lf2zk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.237244 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.237238    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59b6b65e-95b4-4075-9719-f30f7adbdf44-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.237475 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.237267    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.237475 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.237289    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.237475 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:53:47.237400    5967 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Oct 30 21:53:47.237594 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:53:47.237500    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source podName:59b6b65e-95b4-4075-9719-f30f7adbdf44 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:47.737477158 +0000 UTC m=+515.852185501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-9f8ld" (UID: "59b6b65e-95b4-4075-9719-f30f7adbdf44") : configmap "usage-tenancy-proxy-source" not found
Oct 30 21:53:47.237930 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.237901    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.239963 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.239939    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59b6b65e-95b4-4075-9719-f30f7adbdf44-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.300407 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.300354    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf2zk\" (UniqueName: \"kubernetes.io/projected/59b6b65e-95b4-4075-9719-f30f7adbdf44-kube-api-access-lf2zk\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.743399 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.743339    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.744198 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.744178    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/59b6b65e-95b4-4075-9719-f30f7adbdf44-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9f8ld\" (UID: \"59b6b65e-95b4-4075-9719-f30f7adbdf44\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:47.889919 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:47.889884    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:53:48.275042 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.275003    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"]
Oct 30 21:53:48.278225 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:53:48.278197    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b6b65e_95b4_4075_9719_f30f7adbdf44.slice/crio-1a61c9a84afaed87b32394d4924b2d4ffebbde783ca83308de6fe641134441cc WatchSource:0}: Error finding container 1a61c9a84afaed87b32394d4924b2d4ffebbde783ca83308de6fe641134441cc: Status 404 returned error can't find the container with id 1a61c9a84afaed87b32394d4924b2d4ffebbde783ca83308de6fe641134441cc
Oct 30 21:53:48.752674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.752643    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:53:48.757126 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.757110    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:48.819683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.819663    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 21:53:48.819683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.819681    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5l7gs\""
Oct 30 21:53:48.828809 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.828786    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:53:48.852554 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.852533    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:48.852683 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.852591    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lfcg\" (UniqueName: \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:48.953956 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.953923    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:48.954141 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.953989    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lfcg\" (UniqueName: \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:48.956604 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:48.956580    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:49.019110 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.019037    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lfcg\" (UniqueName: \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\") pod \"llmisvc-controller-manager-869d5dcc5d-s6rph\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:49.045231 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.045196    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-f89ml"]
Oct 30 21:53:49.048566 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.048548    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.068893 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.068870    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:49.103795 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.103765    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4wj7g\""
Oct 30 21:53:49.103937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.103834    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 21:53:49.103937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.103851    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 21:53:49.129221 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.128896    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-f89ml"]
Oct 30 21:53:49.155721 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.155694    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-metrics-certs\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.155886 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.155864    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntxh\" (UniqueName: \"kubernetes.io/projected/f95352f5-58ab-485b-bd52-a474348a525a-kube-api-access-6ntxh\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.155996 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.155977    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-cert\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.157890 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.157857    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld" event={"ID":"59b6b65e-95b4-4075-9719-f30f7adbdf44","Type":"ContainerStarted","Data":"1a61c9a84afaed87b32394d4924b2d4ffebbde783ca83308de6fe641134441cc"}
Oct 30 21:53:49.257432 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.257404    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-cert\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.257432 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.257433    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-metrics-certs\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.257657 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.257502    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntxh\" (UniqueName: \"kubernetes.io/projected/f95352f5-58ab-485b-bd52-a474348a525a-kube-api-access-6ntxh\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.259986 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.259961    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-cert\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.260093 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.260014    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f95352f5-58ab-485b-bd52-a474348a525a-metrics-certs\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.320021 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.319949    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntxh\" (UniqueName: \"kubernetes.io/projected/f95352f5-58ab-485b-bd52-a474348a525a-kube-api-access-6ntxh\") pod \"odh-model-controller-769875db56-f89ml\" (UID: \"f95352f5-58ab-485b-bd52-a474348a525a\") " pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.361564 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.361529    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:49.446071 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.446036    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:53:49.449944 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:53:49.449907    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf96aea5c_204b_499c_b769_d010b1d542db.slice/crio-1686abb8c934db9dc328012ecc5de4a48f1049e96cfa5ecc143cbdff8d8cd47b WatchSource:0}: Error finding container 1686abb8c934db9dc328012ecc5de4a48f1049e96cfa5ecc143cbdff8d8cd47b: Status 404 returned error can't find the container with id 1686abb8c934db9dc328012ecc5de4a48f1049e96cfa5ecc143cbdff8d8cd47b
Oct 30 21:53:49.741208 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:49.741181    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-f89ml"]
Oct 30 21:53:49.744230 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:53:49.744200    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95352f5_58ab_485b_bd52_a474348a525a.slice/crio-026ff45c78f43983dc9ad5bd817ab984b67f4355e7639212ed312bb70e37fe09 WatchSource:0}: Error finding container 026ff45c78f43983dc9ad5bd817ab984b67f4355e7639212ed312bb70e37fe09: Status 404 returned error can't find the container with id 026ff45c78f43983dc9ad5bd817ab984b67f4355e7639212ed312bb70e37fe09
Oct 30 21:53:50.163887 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:50.163791    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-f89ml" event={"ID":"f95352f5-58ab-485b-bd52-a474348a525a","Type":"ContainerStarted","Data":"026ff45c78f43983dc9ad5bd817ab984b67f4355e7639212ed312bb70e37fe09"}
Oct 30 21:53:50.164968 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:50.164947    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" event={"ID":"f96aea5c-204b-499c-b769-d010b1d542db","Type":"ContainerStarted","Data":"1686abb8c934db9dc328012ecc5de4a48f1049e96cfa5ecc143cbdff8d8cd47b"}
Oct 30 21:53:53.187681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:53.187638    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" event={"ID":"f96aea5c-204b-499c-b769-d010b1d542db","Type":"ContainerStarted","Data":"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"}
Oct 30 21:53:53.188106 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:53.187924    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:53:53.309926 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:53.309406    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" podStartSLOduration=2.49836545 podStartE2EDuration="5.309387586s" totalImagesPullingTime="2.811022136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:53.30764988 +0000 UTC m=+521.422358243" watchObservedRunningTime="2026-10-30 21:53:53.309387586 +0000 UTC m=+521.424095930"
Oct 30 21:53:55.202406 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:55.202313    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-f89ml" event={"ID":"f95352f5-58ab-485b-bd52-a474348a525a","Type":"ContainerStarted","Data":"061047d086ada431a1a45417b4dc4d00ad625c6a57154a0ee9b0263e064daaab"}
Oct 30 21:53:55.203263 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:55.202965    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:53:55.324505 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:53:55.324445    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-f89ml" podStartSLOduration=2.636964184 podStartE2EDuration="7.324423636s" totalImagesPullingTime="4.687459452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:55.319405823 +0000 UTC m=+523.434114174" watchObservedRunningTime="2026-10-30 21:53:55.324423636 +0000 UTC m=+523.439131990"
Oct 30 21:54:03.248866 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:03.248831    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld" event={"ID":"59b6b65e-95b4-4075-9719-f30f7adbdf44","Type":"ContainerStarted","Data":"1de20a61cd0db4a055e4b026b8abbf7eadd66fd9573cf4a4fd99d9d367570f84"}
Oct 30 21:54:03.249259 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:03.249068    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:54:03.367501 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:03.367440    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld" podStartSLOduration=2.890340389 podStartE2EDuration="17.367422781s" totalImagesPullingTime="14.477082392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:03.366316546 +0000 UTC m=+531.481024918" watchObservedRunningTime="2026-10-30 21:54:03.367422781 +0000 UTC m=+531.482131181"
Oct 30 21:54:05.591843 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:54:05.591735    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:54:06.210592 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:06.210563    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-f89ml"
Oct 30 21:54:07.628484 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:07.628438    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podUID="7ff8f2bfa49239d9e2240c708e676d72" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:54:14.260175 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:14.260144    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld"
Oct 30 21:54:24.196285 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:24.196201    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:54:35.598551 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:54:35.598499    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:54:38.499293 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.499263    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:38.501884 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.501869    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:38.559940 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.559910    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vd4rq\""
Oct 30 21:54:38.610468 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.610431    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:38.629477 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.629423    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zq6b\" (UniqueName: \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\") pod \"authorino-6f6944bcdd-5qn2d\" (UID: \"3905175d-9d3b-4eef-a46b-e054cec3a346\") " pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:38.730440 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.730406    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zq6b\" (UniqueName: \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\") pod \"authorino-6f6944bcdd-5qn2d\" (UID: \"3905175d-9d3b-4eef-a46b-e054cec3a346\") " pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:38.795524 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.795460    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zq6b\" (UniqueName: \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\") pod \"authorino-6f6944bcdd-5qn2d\" (UID: \"3905175d-9d3b-4eef-a46b-e054cec3a346\") " pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:38.812255 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.812230    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:38.965640 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.965610    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:38.997902 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:38.997873    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:39.000652 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.000626    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:39.064841 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.064747    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:39.134780 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.134753    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmlgt\" (UniqueName: \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\") pod \"authorino-749f65745d-6gfk9\" (UID: \"d7feccb8-d35c-47a6-bdbe-83faba912efa\") " pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:39.185680 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.185647    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:39.188750 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:54:39.188709    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3905175d_9d3b_4eef_a46b_e054cec3a346.slice/crio-c000e0fb22cfbadf3028b3ffdb1022144811a381c9eca4aea720aa7a96806676 WatchSource:0}: Error finding container c000e0fb22cfbadf3028b3ffdb1022144811a381c9eca4aea720aa7a96806676: Status 404 returned error can't find the container with id c000e0fb22cfbadf3028b3ffdb1022144811a381c9eca4aea720aa7a96806676
Oct 30 21:54:39.235686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.235662    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmlgt\" (UniqueName: \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\") pod \"authorino-749f65745d-6gfk9\" (UID: \"d7feccb8-d35c-47a6-bdbe-83faba912efa\") " pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:39.300108 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.300075    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmlgt\" (UniqueName: \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\") pod \"authorino-749f65745d-6gfk9\" (UID: \"d7feccb8-d35c-47a6-bdbe-83faba912efa\") " pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:39.309996 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.309967    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:39.310209 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.310195    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:39.414665 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.414630    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" event={"ID":"3905175d-9d3b-4eef-a46b-e054cec3a346","Type":"ContainerStarted","Data":"c000e0fb22cfbadf3028b3ffdb1022144811a381c9eca4aea720aa7a96806676"}
Oct 30 21:54:39.681102 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:39.680854    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:39.683739 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:54:39.683707    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7feccb8_d35c_47a6_bdbe_83faba912efa.slice/crio-47ed0dfe0af83debb919094d16b58e3a3c369c395f21c1a40c10ad91f0021ab8 WatchSource:0}: Error finding container 47ed0dfe0af83debb919094d16b58e3a3c369c395f21c1a40c10ad91f0021ab8: Status 404 returned error can't find the container with id 47ed0dfe0af83debb919094d16b58e3a3c369c395f21c1a40c10ad91f0021ab8
Oct 30 21:54:40.422452 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:40.422415    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-749f65745d-6gfk9" event={"ID":"d7feccb8-d35c-47a6-bdbe-83faba912efa","Type":"ContainerStarted","Data":"47ed0dfe0af83debb919094d16b58e3a3c369c395f21c1a40c10ad91f0021ab8"}
Oct 30 21:54:41.429863 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.429814    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-749f65745d-6gfk9" event={"ID":"d7feccb8-d35c-47a6-bdbe-83faba912efa","Type":"ContainerStarted","Data":"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"}
Oct 30 21:54:41.430318 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.429840    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-749f65745d-6gfk9" podUID="d7feccb8-d35c-47a6-bdbe-83faba912efa" containerName="authorino" containerID="cri-o://a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb" gracePeriod=30
Oct 30 21:54:41.432096 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.432069    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" event={"ID":"3905175d-9d3b-4eef-a46b-e054cec3a346","Type":"ContainerStarted","Data":"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"}
Oct 30 21:54:41.432225 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.432138    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" podUID="3905175d-9d3b-4eef-a46b-e054cec3a346" containerName="authorino" containerID="cri-o://9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c" gracePeriod=30
Oct 30 21:54:41.552597 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.552541    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-749f65745d-6gfk9" podStartSLOduration=2.309979497 podStartE2EDuration="3.552521068s" totalImagesPullingTime="1.242541571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:41.550999693 +0000 UTC m=+569.665708046" watchObservedRunningTime="2026-10-30 21:54:41.552521068 +0000 UTC m=+569.667229419"
Oct 30 21:54:41.668323 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.668266    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" podStartSLOduration=2.4505237859999998 podStartE2EDuration="3.668248699s" totalImagesPullingTime="1.217724913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:41.66740099 +0000 UTC m=+569.782109340" watchObservedRunningTime="2026-10-30 21:54:41.668248699 +0000 UTC m=+569.782957051"
Oct 30 21:54:41.726909 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.726885    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:41.731448 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.731425    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:41.859843 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.859812    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\" (UniqueName: \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\") pod \"d7feccb8-d35c-47a6-bdbe-83faba912efa\" (UID: \"d7feccb8-d35c-47a6-bdbe-83faba912efa\") "
Oct 30 21:54:41.860028 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.859903    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\" (UniqueName: \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\") pod \"3905175d-9d3b-4eef-a46b-e054cec3a346\" (UID: \"3905175d-9d3b-4eef-a46b-e054cec3a346\") "
Oct 30 21:54:41.862052 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.862022    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt" pod "d7feccb8-d35c-47a6-bdbe-83faba912efa" (UID: "d7feccb8-d35c-47a6-bdbe-83faba912efa"). InnerVolumeSpecName "kube-api-access-lmlgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:41.862197 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.862140    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b" pod "3905175d-9d3b-4eef-a46b-e054cec3a346" (UID: "3905175d-9d3b-4eef-a46b-e054cec3a346"). InnerVolumeSpecName "kube-api-access-4zq6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:41.961462 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.961408    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmlgt\" (UniqueName: \"kubernetes.io/projected/d7feccb8-d35c-47a6-bdbe-83faba912efa-kube-api-access-lmlgt\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:41.961462 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:41.961431    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zq6b\" (UniqueName: \"kubernetes.io/projected/3905175d-9d3b-4eef-a46b-e054cec3a346-kube-api-access-4zq6b\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:42.438316 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.438274    5967 generic.go:356] "Generic (PLEG): container finished" podID="3905175d-9d3b-4eef-a46b-e054cec3a346" containerID="9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c" exitCode=0
Oct 30 21:54:42.438828 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.438322    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d"
Oct 30 21:54:42.438828 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.438357    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" event={"ID":"3905175d-9d3b-4eef-a46b-e054cec3a346","Type":"ContainerDied","Data":"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"}
Oct 30 21:54:42.438828 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.438418    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-5qn2d" event={"ID":"3905175d-9d3b-4eef-a46b-e054cec3a346","Type":"ContainerDied","Data":"c000e0fb22cfbadf3028b3ffdb1022144811a381c9eca4aea720aa7a96806676"}
Oct 30 21:54:42.438828 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.438436    5967 scope.go:122] "RemoveContainer" containerID="9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"
Oct 30 21:54:42.439697 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.439667    5967 generic.go:356] "Generic (PLEG): container finished" podID="d7feccb8-d35c-47a6-bdbe-83faba912efa" containerID="a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb" exitCode=0
Oct 30 21:54:42.439760 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.439711    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749f65745d-6gfk9"
Oct 30 21:54:42.439873 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.439753    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-749f65745d-6gfk9" event={"ID":"d7feccb8-d35c-47a6-bdbe-83faba912efa","Type":"ContainerDied","Data":"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"}
Oct 30 21:54:42.439873 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.439798    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-749f65745d-6gfk9" event={"ID":"d7feccb8-d35c-47a6-bdbe-83faba912efa","Type":"ContainerDied","Data":"47ed0dfe0af83debb919094d16b58e3a3c369c395f21c1a40c10ad91f0021ab8"}
Oct 30 21:54:42.446930 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.446915    5967 scope.go:122] "RemoveContainer" containerID="9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"
Oct 30 21:54:42.447193 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:54:42.447176    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c\": container with ID starting with 9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c not found: ID does not exist" containerID="9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"
Oct 30 21:54:42.447268 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.447205    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c"} err="failed to get container status \"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c\": rpc error: code = NotFound desc = could not find container \"9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c\": container with ID starting with 9ee0fb8b5c992b4b09761c3d5149d14b0a8a26417e22f56abe0c9bdb20f0ff1c not found: ID does not exist"
Oct 30 21:54:42.447268 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.447227    5967 scope.go:122] "RemoveContainer" containerID="a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"
Oct 30 21:54:42.454723 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.454703    5967 scope.go:122] "RemoveContainer" containerID="a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"
Oct 30 21:54:42.455003 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:54:42.454982    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb\": container with ID starting with a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb not found: ID does not exist" containerID="a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"
Oct 30 21:54:42.455051 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.455012    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb"} err="failed to get container status \"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb\": rpc error: code = NotFound desc = could not find container \"a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb\": container with ID starting with a115240f2c47505b805fdef9943af2c119b7dd388caadbeef5cd4fb815fa63eb not found: ID does not exist"
Oct 30 21:54:42.603616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.603582    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:42.653155 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.653124    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-749f65745d-6gfk9"]
Oct 30 21:54:42.719753 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.719724    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:42.724836 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:42.724801    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-5qn2d"]
Oct 30 21:54:44.016769 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:44.016736    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3905175d-9d3b-4eef-a46b-e054cec3a346" path="/var/lib/kubelet/pods/3905175d-9d3b-4eef-a46b-e054cec3a346/volumes"
Oct 30 21:54:44.017138 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:54:44.017050    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7feccb8-d35c-47a6-bdbe-83faba912efa" path="/var/lib/kubelet/pods/d7feccb8-d35c-47a6-bdbe-83faba912efa/volumes"
Oct 30 21:55:02.890788 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.890748    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"]
Oct 30 21:55:02.891327 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891306    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d7feccb8-d35c-47a6-bdbe-83faba912efa" containerName="authorino"
Oct 30 21:55:02.891431 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891333    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7feccb8-d35c-47a6-bdbe-83faba912efa" containerName="authorino"
Oct 30 21:55:02.891431 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891363    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3905175d-9d3b-4eef-a46b-e054cec3a346" containerName="authorino"
Oct 30 21:55:02.891431 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891390    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3905175d-9d3b-4eef-a46b-e054cec3a346" containerName="authorino"
Oct 30 21:55:02.891590 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891522    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7feccb8-d35c-47a6-bdbe-83faba912efa" containerName="authorino"
Oct 30 21:55:02.891590 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.891537    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3905175d-9d3b-4eef-a46b-e054cec3a346" containerName="authorino"
Oct 30 21:55:02.893607 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.893587    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:02.952389 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.952336    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjm5f\" (UniqueName: \"kubernetes.io/projected/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-kube-api-access-tjm5f\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:02.952544 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.952468    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-cert\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:02.952800 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:02.952775    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"]
Oct 30 21:55:03.053979 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.053945    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjm5f\" (UniqueName: \"kubernetes.io/projected/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-kube-api-access-tjm5f\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:03.053979 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.053980    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-cert\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:03.056559 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.056536    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-cert\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:03.115506 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.115474    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjm5f\" (UniqueName: \"kubernetes.io/projected/fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4-kube-api-access-tjm5f\") pod \"llmisvc-controller-manager-6466c554d8-mp7g2\" (UID: \"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:03.210865 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.210787    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:03.582199 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:03.582158    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"]
Oct 30 21:55:03.585085 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:55:03.585060    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9bdd14_9b60_4d1a_9fdb_ae5d38bd21f4.slice/crio-244e145190710c7ee47431b61327db27ff01f3d833b2605f4dcab54ac9eee563 WatchSource:0}: Error finding container 244e145190710c7ee47431b61327db27ff01f3d833b2605f4dcab54ac9eee563: Status 404 returned error can't find the container with id 244e145190710c7ee47431b61327db27ff01f3d833b2605f4dcab54ac9eee563
Oct 30 21:55:04.542042 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:04.542004    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2" event={"ID":"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4","Type":"ContainerStarted","Data":"9970c6ece09247cec182d1df167b4242803a63d116ba412fa24e5837c17e9578"}
Oct 30 21:55:04.542442 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:04.542055    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2" event={"ID":"fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4","Type":"ContainerStarted","Data":"244e145190710c7ee47431b61327db27ff01f3d833b2605f4dcab54ac9eee563"}
Oct 30 21:55:04.542442 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:04.542119    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:04.658422 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:04.658274    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2" podStartSLOduration=1.911051212 podStartE2EDuration="2.658256046s" totalImagesPullingTime="747.204834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:55:04.657980208 +0000 UTC m=+592.772688551" watchObservedRunningTime="2026-10-30 21:55:04.658256046 +0000 UTC m=+592.772964396"
Oct 30 21:55:05.591597 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:55:05.591556    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:55:12.067707 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:12.067685    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:55:12.068662 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:12.068638    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 21:55:35.549495 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:35.549462    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2"
Oct 30 21:55:35.592224 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:55:35.592181    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:55:35.716607 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:35.716577    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:55:35.716827 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:35.716801    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" podUID="f96aea5c-204b-499c-b769-d010b1d542db" containerName="manager" containerID="cri-o://fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5" gracePeriod=30
Oct 30 21:55:35.962723 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:35.962695    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:55:36.060107 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.060069    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\" (UniqueName: \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\") pod \"f96aea5c-204b-499c-b769-d010b1d542db\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") "
Oct 30 21:55:36.060276 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.060166    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\" (UniqueName: \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\") pod \"f96aea5c-204b-499c-b769-d010b1d542db\" (UID: \"f96aea5c-204b-499c-b769-d010b1d542db\") "
Oct 30 21:55:36.062400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.062362    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert" pod "f96aea5c-204b-499c-b769-d010b1d542db" (UID: "f96aea5c-204b-499c-b769-d010b1d542db"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:36.062553 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.062530    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg" pod "f96aea5c-204b-499c-b769-d010b1d542db" (UID: "f96aea5c-204b-499c-b769-d010b1d542db"). InnerVolumeSpecName "kube-api-access-4lfcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:36.161483 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.161406    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lfcg\" (UniqueName: \"kubernetes.io/projected/f96aea5c-204b-499c-b769-d010b1d542db-kube-api-access-4lfcg\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:36.161483 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.161431    5967 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96aea5c-204b-499c-b769-d010b1d542db-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:36.687585 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.687550    5967 generic.go:356] "Generic (PLEG): container finished" podID="f96aea5c-204b-499c-b769-d010b1d542db" containerID="fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5" exitCode=0
Oct 30 21:55:36.688066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.687599    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"
Oct 30 21:55:36.688066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.687632    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" event={"ID":"f96aea5c-204b-499c-b769-d010b1d542db","Type":"ContainerDied","Data":"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"}
Oct 30 21:55:36.688066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.687685    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph" event={"ID":"f96aea5c-204b-499c-b769-d010b1d542db","Type":"ContainerDied","Data":"1686abb8c934db9dc328012ecc5de4a48f1049e96cfa5ecc143cbdff8d8cd47b"}
Oct 30 21:55:36.688066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.687707    5967 scope.go:122] "RemoveContainer" containerID="fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"
Oct 30 21:55:36.696659 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.696645    5967 scope.go:122] "RemoveContainer" containerID="fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"
Oct 30 21:55:36.696930 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:55:36.696913    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5\": container with ID starting with fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5 not found: ID does not exist" containerID="fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"
Oct 30 21:55:36.696972 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.696941    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5"} err="failed to get container status \"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5\": rpc error: code = NotFound desc = could not find container \"fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5\": container with ID starting with fb374aec80b5854d1cb4fcffacd2b9f576073427042c7bfbd979a8ef4b1961e5 not found: ID does not exist"
Oct 30 21:55:36.852220 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.852185    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:55:36.901757 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:36.901725    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph"]
Oct 30 21:55:38.016870 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:55:38.016839    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f96aea5c-204b-499c-b769-d010b1d542db" path="/var/lib/kubelet/pods/f96aea5c-204b-499c-b769-d010b1d542db/volumes"
Oct 30 21:56:05.592687 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:56:05.592640    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:56:07.628090 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:07.628043    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podUID="7ff8f2bfa49239d9e2240c708e676d72" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:56:26.412154 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.412112    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 21:56:26.412640 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.412534    5967 cpu_manager.go:414] "containerMap: removing container" podUID="f96aea5c-204b-499c-b769-d010b1d542db" containerName="manager"
Oct 30 21:56:26.412640 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.412546    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f96aea5c-204b-499c-b769-d010b1d542db" containerName="manager"
Oct 30 21:56:26.412640 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.412622    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="f96aea5c-204b-499c-b769-d010b1d542db" containerName="manager"
Oct 30 21:56:26.415901 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.415881    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.468166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.468126    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5mg8\""
Oct 30 21:56:26.468166 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.468151    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:56:26.513238 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513201    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513238 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513244    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513263    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513480 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513461    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513547 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513512    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513583 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513565    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513693 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513675    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513728 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513707    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.513771 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.513729    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgwmk\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.519057 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.519032    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 21:56:26.614379 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614350    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614423    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614468    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614515    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614542    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614581 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614568    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgwmk\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614639    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614668    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614698    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614787    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.614850 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.614810    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.615110 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.615023    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.615224 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.615199    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.615397 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.615331    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.617266 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.617247    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.617403 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.617386    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.676740 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.676671    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.676856 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.676745    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgwmk\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\") pod \"maas-default-gateway-openshift-default-6cc458d887-w5pb8\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:26.728431 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:26.728404    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:27.155109 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:27.155086    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 21:56:27.157935 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:56:27.157905    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5962f24a_1ac2_4dd0_b44b_f92a5ec8cc8a.slice/crio-a750094196071fbf304aed7805a573c67f190ef821f43dc28e001e213a677fb9 WatchSource:0}: Error finding container a750094196071fbf304aed7805a573c67f190ef821f43dc28e001e213a677fb9: Status 404 returned error can't find the container with id a750094196071fbf304aed7805a573c67f190ef821f43dc28e001e213a677fb9
Oct 30 21:56:27.915010 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:27.914969    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" event={"ID":"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a","Type":"ContainerStarted","Data":"a750094196071fbf304aed7805a573c67f190ef821f43dc28e001e213a677fb9"}
Oct 30 21:56:30.946077 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:30.946043    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:56:30.946400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:30.946114    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:56:30.946400 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:30.946143    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:56:31.937029 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:31.936991    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" event={"ID":"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a","Type":"ContainerStarted","Data":"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"}
Oct 30 21:56:32.170483 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:32.170425    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podStartSLOduration=2.385089393 podStartE2EDuration="6.170409997s" totalImagesPullingTime="3.785320604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:32.120036984 +0000 UTC m=+680.234745360" watchObservedRunningTime="2026-10-30 21:56:32.170409997 +0000 UTC m=+680.285118347"
Oct 30 21:56:32.729055 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:32.729017    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:32.730727 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:32.730697    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:32.730858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:32.730753    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:33.729731 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:33.729696    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:33.730143 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:33.729752    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:34.729399 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:34.729325    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:34.729620 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:34.729438    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:35.614808 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:56:35.614771    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:56:35.729421 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:35.729357    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:35.729601 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:35.729441    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:36.728771 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:36.728734    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:36.729252 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:36.728791    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:37.729331 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:37.729295    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-w5pb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:56:37.729739 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:37.729360    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 21:56:39.189009 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:39.188974    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:39.189505 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:39.189406    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:56:39.190631 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:56:39.190613    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 21:57:05.592005 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:57:05.591971    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:57:26.876525 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:26.876450    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 21:57:26.879857 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:26.879832    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:26.926303 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:26.926279    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"]
Oct 30 21:57:26.929686 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:26.929670    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:26.983916 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:26.983891    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 21:57:27.002345 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002319    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002356    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002500 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002400    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002570 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002509    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002570 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002540    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002570 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002560    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002745 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002727    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002780 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002755    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.002812 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.002781    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpm4\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.054211 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.054158    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"]
Oct 30 21:57:27.103688 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103652    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.103858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103696    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65htn\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-kube-api-access-65htn\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.103858 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103733    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cde9df19-6dd8-470c-ac0e-e53397101e42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.103947 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103863    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.103947 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103933    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104010 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103956    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104010 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.103979    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpm4\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104010 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104000    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.104117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104019    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.104117 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104077    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104222 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104187    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.104277 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104235    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104277 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104262    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104415 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104313    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104415 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104340    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104415 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104345    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104415 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104365    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104630 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104430    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.104630 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104465    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.104734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104658    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104734 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104684    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104848 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104777    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.104848 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.104799    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.106939 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.106909    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.107052 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.106914    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.165261 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.165195    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.165510 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.165487    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpm4\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\") pod \"maas-default-gateway-openshift-default-6cc458d887-qg5cq\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.191619 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.191594    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:27.205881 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.205854    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.205999 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.205893    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206070 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206037    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206135 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206089    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65htn\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-kube-api-access-65htn\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206141    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cde9df19-6dd8-470c-ac0e-e53397101e42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206190 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206173    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206290 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206244    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206290 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206273    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206418 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206300    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206476 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206447    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206535 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206494    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206611 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206589    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.206674 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.206629    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.207178 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.207136    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cde9df19-6dd8-470c-ac0e-e53397101e42-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.208841 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.208824    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.209177 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.209150    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.267530 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.267325    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.267718 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.267651    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65htn\" (UniqueName: \"kubernetes.io/projected/cde9df19-6dd8-470c-ac0e-e53397101e42-kube-api-access-65htn\") pod \"maas-default-gateway-openshift-default-6cc458d887-f89xr\" (UID: \"cde9df19-6dd8-470c-ac0e-e53397101e42\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.541490 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.541461    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:27.615984 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.615928    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 21:57:27.622111 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.622077    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:27.622197 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.622148    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:27.622197 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.622182    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:27.921750 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.921663    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"]
Oct 30 21:57:27.925267 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:57:27.925234    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde9df19_6dd8_470c_ac0e_e53397101e42.slice/crio-a3e57029dadb2066dd84a7675cd3e536f91dd45c9a14b1c91c79f7922bf0c804 WatchSource:0}: Error finding container a3e57029dadb2066dd84a7675cd3e536f91dd45c9a14b1c91c79f7922bf0c804: Status 404 returned error can't find the container with id a3e57029dadb2066dd84a7675cd3e536f91dd45c9a14b1c91c79f7922bf0c804
Oct 30 21:57:27.927675 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.927632    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:27.927753 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.927726    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:27.927796 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:27.927770    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 21:57:28.220118 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.219124    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" event={"ID":"cde9df19-6dd8-470c-ac0e-e53397101e42","Type":"ContainerStarted","Data":"b80f018a71363f21936b4d5472ae2059700f2218e118d56ccc42a93a40e05d9c"}
Oct 30 21:57:28.220118 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.219186    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" event={"ID":"cde9df19-6dd8-470c-ac0e-e53397101e42","Type":"ContainerStarted","Data":"a3e57029dadb2066dd84a7675cd3e536f91dd45c9a14b1c91c79f7922bf0c804"}
Oct 30 21:57:28.223152 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.223128    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" event={"ID":"c3653d62-19e8-4939-b9f6-bf2d2ed312f9","Type":"ContainerStarted","Data":"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"}
Oct 30 21:57:28.223311 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.223302    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" event={"ID":"c3653d62-19e8-4939-b9f6-bf2d2ed312f9","Type":"ContainerStarted","Data":"7b57ef08efe87b9467daf6e88e2b7c4f8da533ccd9f1dc9842ee492250acf8a3"}
Oct 30 21:57:28.388849 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.388528    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podStartSLOduration=2.388508389 podStartE2EDuration="2.388508389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:28.387716334 +0000 UTC m=+736.502424686" watchObservedRunningTime="2026-10-30 21:57:28.388508389 +0000 UTC m=+736.503216742"
Oct 30 21:57:28.517456 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.512268    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podStartSLOduration=2.512248547 podStartE2EDuration="2.512248547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:28.511839111 +0000 UTC m=+736.626547465" watchObservedRunningTime="2026-10-30 21:57:28.512248547 +0000 UTC m=+736.626956902"
Oct 30 21:57:28.542220 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.541794    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:28.543225 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.543200    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:28.543327 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:28.543264    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:29.203943 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:29.203907    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:29.204620 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:29.204595    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:29.204803 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:29.204772    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:29.542229 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:29.542189    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:29.542428 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:29.542259    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:30.194044 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:30.193992    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:30.194425 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:30.194361    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:30.541899 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:30.541864    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:30.542294 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:30.541935    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:31.195407 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:31.194823    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:31.195407 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:31.194902    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:31.542891 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:31.542842    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:31.543321 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:31.542905    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:32.194884 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:32.194843    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:32.195151 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:32.195120    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:32.542613 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:32.542574    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:32.542822 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:32.542640    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:33.204777 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:33.204746    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:33.205404 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:33.205335    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:33.542711 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:33.542673    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:33.542881 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:33.542734    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:34.192618 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:34.192579    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:34.192834 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:34.192643    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:34.541917 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:34.541872    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Oct 30 21:57:34.542418 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:34.541957    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Oct 30 21:57:35.192192 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:35.192152    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qg5cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 21:57:35.192422 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:35.192218    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 21:57:35.606282 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:57:35.606234    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:57:36.196397 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.196353    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:36.196681 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.196655    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:36.197391 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.197348    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 21:57:36.293921 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.293891    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:36.294217 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.294199    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:57:36.294959 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:57:36.294942    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr"
Oct 30 21:58:05.591558 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:58:05.591514    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:58:35.592578 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:58:35.592542    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:58:40.870876 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:40.870845    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 21:58:40.874397 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:40.874359    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:40.927016 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:40.926979    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-a7b06b\""
Oct 30 21:58:40.927170 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:40.927078    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-a7b06b-dockercfg-vdmxf\""
Oct 30 21:58:40.932383 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:40.932345    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 21:58:41.041887 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.041858    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.042055 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.041915    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plkf7\" (UniqueName: \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.143285 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.143202    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkf7\" (UniqueName: \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.143490 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.143334    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.144074 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.144052    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.204795 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.204773    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plkf7\" (UniqueName: \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\") pod \"payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.486672 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.486644    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:41.858068 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.858043    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 21:58:41.861041 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:58:41.861007    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81060fd5_e321_44fd_8e11_c2dc2392ad20.slice/crio-3579b5aac4220526f0cb6b4103ce1072ce5c98a27e37133dba16f9debdd00d66 WatchSource:0}: Error finding container 3579b5aac4220526f0cb6b4103ce1072ce5c98a27e37133dba16f9debdd00d66: Status 404 returned error can't find the container with id 3579b5aac4220526f0cb6b4103ce1072ce5c98a27e37133dba16f9debdd00d66
Oct 30 21:58:41.863124 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:41.863105    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:58:42.585362 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:42.585321    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" event={"ID":"81060fd5-e321-44fd-8e11-c2dc2392ad20","Type":"ContainerStarted","Data":"3579b5aac4220526f0cb6b4103ce1072ce5c98a27e37133dba16f9debdd00d66"}
Oct 30 21:58:44.596981 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:44.596952    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" event={"ID":"81060fd5-e321-44fd-8e11-c2dc2392ad20","Type":"ContainerStarted","Data":"8126059cc6559d6d84f83ba02a3df86c3b63ad4454a813844c66d899dfcddc56"}
Oct 30 21:58:44.597406 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:44.597072    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:58:44.714126 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:44.714074    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" podStartSLOduration=2.142708003 podStartE2EDuration="4.71405967s" totalImagesPullingTime="2.571351667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:44.713180276 +0000 UTC m=+812.827888663" watchObservedRunningTime="2026-10-30 21:58:44.71405967 +0000 UTC m=+812.828768060"
Oct 30 21:58:55.605110 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:58:55.605082    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 21:59:03.990813 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:03.990776    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 21:59:03.994838 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:03.994819    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.047418 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.047387    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-7df73b-serving-cert\""
Oct 30 21:59:04.065937 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.065911    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.066071 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.065947    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.066071 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.065978    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h989c\" (UniqueName: \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.066183 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.066158    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.096950 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.096922    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:59:04.096950 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.096938    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp6qk\""
Oct 30 21:59:04.097148 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.097099    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:59:04.097212 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.097191    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:59:04.098623 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.098605    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 21:59:04.167332 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.167299    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.167519 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.167421    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.167519 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.167448    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.167519 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.167470    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h989c\" (UniqueName: \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.167618 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:04.167583    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-serving-cert: secret "maas-api-e2e-worker-w0-7df73b-serving-cert" not found
Oct 30 21:59:04.167674 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:04.167664    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls podName:3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1 nodeName:}" failed. No retries permitted until 2026-10-30 21:59:04.667646462 +0000 UTC m=+832.782354791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls") pod "maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" (UID: "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1") : secret "maas-api-e2e-worker-w0-7df73b-serving-cert" not found
Oct 30 21:59:04.168131 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.168105    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.169819 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.169800    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.229459 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.229420    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h989c\" (UniqueName: \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.671700 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.671666    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.674176 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.674155    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:04.908161 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:04.908126    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:05.286313 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:05.286289    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 21:59:05.289043 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:59:05.289012    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3087ca6e_ebe6_4225_a6eb_2259bf0dd1c1.slice/crio-45fe2bb7601a4355b32d0603ade05a339a0299f17e6095270b0141f4308d951e WatchSource:0}: Error finding container 45fe2bb7601a4355b32d0603ade05a339a0299f17e6095270b0141f4308d951e: Status 404 returned error can't find the container with id 45fe2bb7601a4355b32d0603ade05a339a0299f17e6095270b0141f4308d951e
Oct 30 21:59:05.591990 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:05.591862    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:59:05.701045 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:05.701012    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" event={"ID":"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1","Type":"ContainerStarted","Data":"45fe2bb7601a4355b32d0603ade05a339a0299f17e6095270b0141f4308d951e"}
Oct 30 21:59:08.722195 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:08.722165    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" event={"ID":"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1","Type":"ContainerStarted","Data":"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"}
Oct 30 21:59:08.722667 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:08.722232    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:08.843149 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:08.843076    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" podStartSLOduration=2.808308696 podStartE2EDuration="5.843059369s" totalImagesPullingTime="3.034750673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:08.840560577 +0000 UTC m=+836.955268927" watchObservedRunningTime="2026-10-30 21:59:08.843059369 +0000 UTC m=+836.957767723"
Oct 30 21:59:14.747626 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:14.747597    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 21:59:18.922426 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:18.922394    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 21:59:18.929873 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:18.929854    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:18.984657 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:18.984622    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-bf7cbf-serving-cert\""
Oct 30 21:59:19.011708 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.011672    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljzkt\" (UniqueName: \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.011874 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.011735    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.011874 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.011853    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.011949 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.011891    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.035756 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.035725    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 21:59:19.112912 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.112880    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljzkt\" (UniqueName: \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.113078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.112929    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.113078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.112988    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.113078 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.113012    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.113210 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:19.113125    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-serving-cert: secret "maas-api-e2e-worker-w1-bf7cbf-serving-cert" not found
Oct 30 21:59:19.113246 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:19.113214    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls podName:d9b011fb-a656-4889-8d95-71adabe71a51 nodeName:}" failed. No retries permitted until 2026-10-30 21:59:19.613196537 +0000 UTC m=+847.727904879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls") pod "maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" (UID: "d9b011fb-a656-4889-8d95-71adabe71a51") : secret "maas-api-e2e-worker-w1-bf7cbf-serving-cert" not found
Oct 30 21:59:19.113766 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.113747    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.115598 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.115579    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.176707 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.176635    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljzkt\" (UniqueName: \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.618680 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.618644    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.621165 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.621135    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") pod \"maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:19.843512 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:19.843475    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:20.222030 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:20.222001    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 21:59:20.224997 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:59:20.224969    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b011fb_a656_4889_8d95_71adabe71a51.slice/crio-29a7d7a176d327b093599ecf4455489cfaa17df8362c80c15672b99799e060ad WatchSource:0}: Error finding container 29a7d7a176d327b093599ecf4455489cfaa17df8362c80c15672b99799e060ad: Status 404 returned error can't find the container with id 29a7d7a176d327b093599ecf4455489cfaa17df8362c80c15672b99799e060ad
Oct 30 21:59:20.782751 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:20.782716    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" event={"ID":"d9b011fb-a656-4889-8d95-71adabe71a51","Type":"ContainerStarted","Data":"29a7d7a176d327b093599ecf4455489cfaa17df8362c80c15672b99799e060ad"}
Oct 30 21:59:21.789204 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:21.789171    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" event={"ID":"d9b011fb-a656-4889-8d95-71adabe71a51","Type":"ContainerStarted","Data":"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"}
Oct 30 21:59:21.789616 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:21.789273    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:21.918772 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:21.918717    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" podStartSLOduration=3.115979364 podStartE2EDuration="3.918702362s" totalImagesPullingTime="802.722998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:21.918122129 +0000 UTC m=+850.032830482" watchObservedRunningTime="2026-10-30 21:59:21.918702362 +0000 UTC m=+850.033410707"
Oct 30 21:59:25.876999 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.876972    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 21:59:25.880604 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.880585    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.932916 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.932889    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"kube-root-ca.crt\""
Oct 30 21:59:25.980592 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980549    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.980742 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980615    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.980742 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980675    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.980742 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980708    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.980841 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980756    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.980884 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.980867    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnhsx\" (UniqueName: \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:25.982363 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.982350    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"openshift-service-ca.crt\""
Oct 30 21:59:25.982557 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.982544    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"simulator-w2-b2f165-kserve-self-signed-certs\""
Oct 30 21:59:25.982613 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.982598    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"default-dockercfg-dprf7\""
Oct 30 21:59:25.984066 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:25.984050    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 21:59:26.081717 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081680    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnhsx\" (UniqueName: \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.081904 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081746    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.081904 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081797    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.081904 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081820    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.081904 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081844    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.081904 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.081868    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.082282 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.082260    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.082410 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.082332    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.082475 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.082407    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.084148 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.084124    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.084607 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.084586    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.147735 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.147663    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnhsx\" (UniqueName: \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\") pod \"simulator-w2-b2f165-kserve-bf67596d5-6pvpx\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") " pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.192718 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.192664    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:26.568942 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.568820    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 21:59:26.571877 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:59:26.571845    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod058475ce_5615_4507_a424_77778ae19f84.slice/crio-19dd7e2d0fdbe836fc8017dee98dcb457c63cc2d1e4a261919ab7dd6462f0bdf WatchSource:0}: Error finding container 19dd7e2d0fdbe836fc8017dee98dcb457c63cc2d1e4a261919ab7dd6462f0bdf: Status 404 returned error can't find the container with id 19dd7e2d0fdbe836fc8017dee98dcb457c63cc2d1e4a261919ab7dd6462f0bdf
Oct 30 21:59:26.814062 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:26.814028    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" event={"ID":"058475ce-5615-4507-a424-77778ae19f84","Type":"ContainerStarted","Data":"19dd7e2d0fdbe836fc8017dee98dcb457c63cc2d1e4a261919ab7dd6462f0bdf"}
Oct 30 21:59:27.800185 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:27.800151    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 21:59:28.825479 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:28.825439    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" event={"ID":"058475ce-5615-4507-a424-77778ae19f84","Type":"ContainerStarted","Data":"af059e378c1e92f5ea40b9cccdb90442b7bdc82694de5ef54d6a140c1c7e8c3c"}
Oct 30 21:59:28.947019 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:28.946954    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podStartSLOduration=2.449134979 podStartE2EDuration="3.946934248s" totalImagesPullingTime="1.497799269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:28.946398995 +0000 UTC m=+857.061107348" watchObservedRunningTime="2026-10-30 21:59:28.946934248 +0000 UTC m=+857.061642605"
Oct 30 21:59:29.193237 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:29.193138    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:35.592504 ip-10-0-130-176 kubenswrapper[5967]: E1030 21:59:35.592469    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 21:59:36.193455 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:36.193414    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:36.206094 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:36.206071    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:36.876217 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:36.876182    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 21:59:54.081464 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.081430    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 21:59:54.088109 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.088091    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164290 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164253    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164488 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164302    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2wrs\" (UniqueName: \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164488 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164323    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164574 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164507    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164649 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164627    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.164704 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.164689    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.195968 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.195937    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-a7b06b\"/\"openshift-service-ca.crt\""
Oct 30 21:59:54.196146 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.195979    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-a7b06b\"/\"kube-root-ca.crt\""
Oct 30 21:59:54.196435 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.196418    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-a7b06b\"/\"simulator-w5-a7b06b-kserve-self-signed-certs\""
Oct 30 21:59:54.196490 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.196462    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-a7b06b\"/\"default-dockercfg-82vdb\""
Oct 30 21:59:54.197619 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.197601    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 21:59:54.265220 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265194    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265408 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265276    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265408 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265306    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2wrs\" (UniqueName: \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265408 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265323    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265408 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265346    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265608 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265436    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265709 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265693    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265783 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265766    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.265846 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.265781    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.267948 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.267918    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.268073 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.268059    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.326762 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.326725    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2wrs\" (UniqueName: \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\") pod \"simulator-w5-a7b06b-kserve-c9d5996c8-w74wl\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") " pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.400665 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.400572    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 21:59:54.795324 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.795286    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 21:59:54.799254 ip-10-0-130-176 kubenswrapper[5967]: W1030 21:59:54.799222    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd840947_3699_4ae5_b1b7_7eda545c95fc.slice/crio-db8947087a67e33896b3a448634b150a76b4029d7f595504f3a5c3c434bd2c8a WatchSource:0}: Error finding container db8947087a67e33896b3a448634b150a76b4029d7f595504f3a5c3c434bd2c8a: Status 404 returned error can't find the container with id db8947087a67e33896b3a448634b150a76b4029d7f595504f3a5c3c434bd2c8a
Oct 30 21:59:54.956410 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.956348    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" event={"ID":"cd840947-3699-4ae5-b1b7-7eda545c95fc","Type":"ContainerStarted","Data":"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"}
Oct 30 21:59:54.956612 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:54.956423    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" event={"ID":"cd840947-3699-4ae5-b1b7-7eda545c95fc","Type":"ContainerStarted","Data":"db8947087a67e33896b3a448634b150a76b4029d7f595504f3a5c3c434bd2c8a"}
Oct 30 21:59:55.073646 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:55.073490    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podStartSLOduration=1.073473143 podStartE2EDuration="1.073473143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:55.072814097 +0000 UTC m=+883.187522446" watchObservedRunningTime="2026-10-30 21:59:55.073473143 +0000 UTC m=+883.188181495"
Oct 30 21:59:55.401528 ip-10-0-130-176 kubenswrapper[5967]: I1030 21:59:55.401426    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:00:00.187403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.187354    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:00.193715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.193688    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.207351 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.207189    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:00.211946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.211923    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:00.212089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.212058    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.215707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.215682    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.254508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.254487    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:00:00.293674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.293613    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:00.327357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327328    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.327556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327454    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.327556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327498    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.327556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327528    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7wfk\" (UniqueName: \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.327678 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327563    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh4ts\" (UniqueName: \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.327715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.327706    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88grj\" (UniqueName: \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.345069 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.345040    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:00.347091 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.347066    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:00.428765 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.428733    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh4ts\" (UniqueName: \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.428986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.428962    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88grj\" (UniqueName: \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.429103 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.429057    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.429243 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.429162    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.429243 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.429215    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.429340 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.429268    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7wfk\" (UniqueName: \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.430063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.430035    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.430169 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.430104    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.430169 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.430133    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.490042 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.490014    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88grj\" (UniqueName: \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\") pod \"maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.490172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.490083    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh4ts\" (UniqueName: \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\") pod \"maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.490172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.490092    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7wfk\" (UniqueName: \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\") pod \"maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.519086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.519062    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:00.532704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.532680    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:00.536849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.536829    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:00.915050 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.915023    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:00.917089 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:00.917048    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa851fc3_2bf7_4028_ae83_e45ca685994e.slice/crio-966939fea3bccdb5e94d8f52ece749ab6a00228ba681c8f16f9adaa2285ccfcb WatchSource:0}: Error finding container 966939fea3bccdb5e94d8f52ece749ab6a00228ba681c8f16f9adaa2285ccfcb: Status 404 returned error can't find the container with id 966939fea3bccdb5e94d8f52ece749ab6a00228ba681c8f16f9adaa2285ccfcb
Oct 30 22:00:00.965231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.965038    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:00.968826 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:00.968799    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278c5226_690a_46e9_8ba4_203700697b9e.slice/crio-124c306851cd863273e033aba5eceae13048fef413aab49315a5291a57f53bac WatchSource:0}: Error finding container 124c306851cd863273e033aba5eceae13048fef413aab49315a5291a57f53bac: Status 404 returned error can't find the container with id 124c306851cd863273e033aba5eceae13048fef413aab49315a5291a57f53bac
Oct 30 22:00:00.969284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.969255    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:00.971213 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:00.971191    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c4d61e_0b13_4e80_8422_1ab1112dea95.slice/crio-15030b183e36ec40d394033f73d5d75b3b43099955d40e6621b4005027042397 WatchSource:0}: Error finding container 15030b183e36ec40d394033f73d5d75b3b43099955d40e6621b4005027042397: Status 404 returned error can't find the container with id 15030b183e36ec40d394033f73d5d75b3b43099955d40e6621b4005027042397
Oct 30 22:00:00.987457 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.987415    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" event={"ID":"fa851fc3-2bf7-4028-ae83-e45ca685994e","Type":"ContainerStarted","Data":"966939fea3bccdb5e94d8f52ece749ab6a00228ba681c8f16f9adaa2285ccfcb"}
Oct 30 22:00:00.988768 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.988741    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerStarted","Data":"124c306851cd863273e033aba5eceae13048fef413aab49315a5291a57f53bac"}
Oct 30 22:00:00.990003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:00.989977    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerStarted","Data":"15030b183e36ec40d394033f73d5d75b3b43099955d40e6621b4005027042397"}
Oct 30 22:00:01.844492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.844455    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:00:01.849987 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.849966    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.951946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.951913    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.952147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.951992    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.952147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.952082    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.952147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.952125    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxr89\" (UniqueName: \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.952301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.952238    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.952352 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.952313    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:01.955638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.955620    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"default-dockercfg-l2zhl\""
Oct 30 22:00:01.955638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.955647    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"simulator-w6-b9fbe2-kserve-self-signed-certs\""
Oct 30 22:00:01.957312 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.957290    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:00:01.989733 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.989711    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"openshift-service-ca.crt\""
Oct 30 22:00:01.989855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:01.989840    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"kube-root-ca.crt\""
Oct 30 22:00:02.053261 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053225    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053488 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053266    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053488 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053343    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053488 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053469    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053512    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053539    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr89\" (UniqueName: \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053702    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053908 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053886    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.053964 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.053909    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.055683 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.055665    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.055921 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.055903    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.115673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.115599    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr89\" (UniqueName: \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\") pod \"simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") " pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.162495 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.162458    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:02.550501 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:02.550471    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:00:02.553682 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:02.553648    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d3d26b8_e5bb_4753_8aa9_0830623104e2.slice/crio-0e7be95cb21634cc41ca67f02a3951a98db0de34efb4c868874c3c3314660578 WatchSource:0}: Error finding container 0e7be95cb21634cc41ca67f02a3951a98db0de34efb4c868874c3c3314660578: Status 404 returned error can't find the container with id 0e7be95cb21634cc41ca67f02a3951a98db0de34efb4c868874c3c3314660578
Oct 30 22:00:03.002037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:03.002002    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" event={"ID":"3d3d26b8-e5bb-4753-8aa9-0830623104e2","Type":"ContainerStarted","Data":"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"}
Oct 30 22:00:03.002499 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:03.002050    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" event={"ID":"3d3d26b8-e5bb-4753-8aa9-0830623104e2","Type":"ContainerStarted","Data":"0e7be95cb21634cc41ca67f02a3951a98db0de34efb4c868874c3c3314660578"}
Oct 30 22:00:03.122646 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:03.122594    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podStartSLOduration=2.122578984 podStartE2EDuration="2.122578984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:03.121883079 +0000 UTC m=+891.236591431" watchObservedRunningTime="2026-10-30 22:00:03.122578984 +0000 UTC m=+891.237287332"
Oct 30 22:00:03.163567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:03.163537    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:04.401184 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:04.401139    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:00:04.418156 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:04.418132    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:00:05.031181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:05.031148    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:00:05.607675 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:05.607618    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:00:06.021735 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:06.021705    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerStarted","Data":"2b5a4c3b029d15b1c2c86c5869e97be523eae4d811a42fc4d3e80f5e6ad6e7f7"}
Oct 30 22:00:06.138216 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:06.138164    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" podStartSLOduration=1.7293396749999999 podStartE2EDuration="6.138148618s" totalImagesPullingTime="4.408808943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:06.13658786 +0000 UTC m=+894.251296221" watchObservedRunningTime="2026-10-30 22:00:06.138148618 +0000 UTC m=+894.252856970"
Oct 30 22:00:07.029640 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.029606    5967 generic.go:356] "Generic (PLEG): container finished" podID="278c5226-690a-46e9-8ba4-203700697b9e" containerID="a87d0dda9261d466925e5169e9a4a09b31cc2dbf6da541200ecb79c7cf1fee66" exitCode=60
Oct 30 22:00:07.030102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.029689    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerDied","Data":"a87d0dda9261d466925e5169e9a4a09b31cc2dbf6da541200ecb79c7cf1fee66"}
Oct 30 22:00:07.030102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.029925    5967 scope.go:122] "RemoveContainer" containerID="a87d0dda9261d466925e5169e9a4a09b31cc2dbf6da541200ecb79c7cf1fee66"
Oct 30 22:00:07.031289 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.031270    5967 generic.go:356] "Generic (PLEG): container finished" podID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerID="2b5a4c3b029d15b1c2c86c5869e97be523eae4d811a42fc4d3e80f5e6ad6e7f7" exitCode=60
Oct 30 22:00:07.031445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.031415    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerDied","Data":"2b5a4c3b029d15b1c2c86c5869e97be523eae4d811a42fc4d3e80f5e6ad6e7f7"}
Oct 30 22:00:07.031670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.031652    5967 scope.go:122] "RemoveContainer" containerID="2b5a4c3b029d15b1c2c86c5869e97be523eae4d811a42fc4d3e80f5e6ad6e7f7"
Oct 30 22:00:07.033168 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.033145    5967 generic.go:356] "Generic (PLEG): container finished" podID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerID="ad1e06e26fdcbf1c43d8cc64d3481038f0cd110b9c8dd99aa9a06f59af46e4b9" exitCode=60
Oct 30 22:00:07.033265 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.033179    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" event={"ID":"fa851fc3-2bf7-4028-ae83-e45ca685994e","Type":"ContainerDied","Data":"ad1e06e26fdcbf1c43d8cc64d3481038f0cd110b9c8dd99aa9a06f59af46e4b9"}
Oct 30 22:00:07.033476 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:07.033458    5967 scope.go:122] "RemoveContainer" containerID="ad1e06e26fdcbf1c43d8cc64d3481038f0cd110b9c8dd99aa9a06f59af46e4b9"
Oct 30 22:00:08.040203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.040172    5967 generic.go:356] "Generic (PLEG): container finished" podID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerID="de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c" exitCode=60
Oct 30 22:00:08.040625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.040248    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerDied","Data":"de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c"}
Oct 30 22:00:08.040625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.040312    5967 scope.go:122] "RemoveContainer" containerID="2b5a4c3b029d15b1c2c86c5869e97be523eae4d811a42fc4d3e80f5e6ad6e7f7"
Oct 30 22:00:08.040625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.040566    5967 scope.go:122] "RemoveContainer" containerID="de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c"
Oct 30 22:00:08.040882 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:08.040860    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj_odh-ai-gateway-infra(c6c4d61e-0b13-4e80-8422-1ab1112dea95)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95"
Oct 30 22:00:08.042293 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.042273    5967 generic.go:356] "Generic (PLEG): container finished" podID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerID="88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d" exitCode=60
Oct 30 22:00:08.042407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.042354    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" event={"ID":"fa851fc3-2bf7-4028-ae83-e45ca685994e","Type":"ContainerDied","Data":"88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d"}
Oct 30 22:00:08.042605 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.042590    5967 scope.go:122] "RemoveContainer" containerID="88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d"
Oct 30 22:00:08.042867 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:08.042850    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt_odh-ai-gateway-infra(fa851fc3-2bf7-4028-ae83-e45ca685994e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e"
Oct 30 22:00:08.044028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.044008    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerStarted","Data":"34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"}
Oct 30 22:00:08.058785 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.058770    5967 scope.go:122] "RemoveContainer" containerID="ad1e06e26fdcbf1c43d8cc64d3481038f0cd110b9c8dd99aa9a06f59af46e4b9"
Oct 30 22:00:08.384901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:08.384851    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" podStartSLOduration=3.6323954389999997 podStartE2EDuration="8.384836018s" totalImagesPullingTime="4.752440579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:08.383471296 +0000 UTC m=+896.498179650" watchObservedRunningTime="2026-10-30 22:00:08.384836018 +0000 UTC m=+896.499544369"
Oct 30 22:00:09.050883 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.050851    5967 scope.go:122] "RemoveContainer" containerID="88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d"
Oct 30 22:00:09.051336 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:09.051123    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt_odh-ai-gateway-infra(fa851fc3-2bf7-4028-ae83-e45ca685994e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e"
Oct 30 22:00:09.052677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.052652    5967 generic.go:356] "Generic (PLEG): container finished" podID="278c5226-690a-46e9-8ba4-203700697b9e" containerID="34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47" exitCode=60
Oct 30 22:00:09.052825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.052701    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerDied","Data":"34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"}
Oct 30 22:00:09.052825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.052758    5967 scope.go:122] "RemoveContainer" containerID="a87d0dda9261d466925e5169e9a4a09b31cc2dbf6da541200ecb79c7cf1fee66"
Oct 30 22:00:09.053056 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.053039    5967 scope.go:122] "RemoveContainer" containerID="34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"
Oct 30 22:00:09.053358 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:09.053335    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66_odh-ai-gateway-infra(278c5226-690a-46e9-8ba4-203700697b9e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" podUID="278c5226-690a-46e9-8ba4-203700697b9e"
Oct 30 22:00:09.054773 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:09.054759    5967 scope.go:122] "RemoveContainer" containerID="de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c"
Oct 30 22:00:09.054982 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:09.054967    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj_odh-ai-gateway-infra(c6c4d61e-0b13-4e80-8422-1ab1112dea95)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95"
Oct 30 22:00:10.062148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:10.062124    5967 scope.go:122] "RemoveContainer" containerID="34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"
Oct 30 22:00:10.062545 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:10.062357    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66_odh-ai-gateway-infra(278c5226-690a-46e9-8ba4-203700697b9e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" podUID="278c5226-690a-46e9-8ba4-203700697b9e"
Oct 30 22:00:12.105973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:12.105945    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:00:12.106998 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:12.106976    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:00:12.163223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:12.163186    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:12.176932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:12.176902    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:13.087653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:13.087622    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:00:19.011467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:19.011435    5967 scope.go:122] "RemoveContainer" containerID="88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d"
Oct 30 22:00:19.849450 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:19.849417    5967 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa851fc3_2bf7_4028_ae83_e45ca685994e.slice/crio-conmon-5ff556f5e4a9008e6a88443365b92c665128937d09cffdd79d89b3166e2bcb03.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 22:00:20.011946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:20.011917    5967 scope.go:122] "RemoveContainer" containerID="34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"
Oct 30 22:00:20.114696 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:20.114664    5967 generic.go:356] "Generic (PLEG): container finished" podID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerID="5ff556f5e4a9008e6a88443365b92c665128937d09cffdd79d89b3166e2bcb03" exitCode=60
Oct 30 22:00:20.114833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:20.114731    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" event={"ID":"fa851fc3-2bf7-4028-ae83-e45ca685994e","Type":"ContainerDied","Data":"5ff556f5e4a9008e6a88443365b92c665128937d09cffdd79d89b3166e2bcb03"}
Oct 30 22:00:20.114833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:20.114780    5967 scope.go:122] "RemoveContainer" containerID="88c62a42b2dc5881f17da6a2b6eb001a4a51f39b5efc043bb61a41d4bc26ff4d"
Oct 30 22:00:20.115155 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:20.115136    5967 scope.go:122] "RemoveContainer" containerID="5ff556f5e4a9008e6a88443365b92c665128937d09cffdd79d89b3166e2bcb03"
Oct 30 22:00:20.115465 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:20.115436    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt_odh-ai-gateway-infra(fa851fc3-2bf7-4028-ae83-e45ca685994e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e"
Oct 30 22:00:21.011550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.011516    5967 scope.go:122] "RemoveContainer" containerID="de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c"
Oct 30 22:00:21.122829 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.122792    5967 generic.go:356] "Generic (PLEG): container finished" podID="278c5226-690a-46e9-8ba4-203700697b9e" containerID="e787f3c0453274d11f25b01217effb53c2d452ed38274bfb74c926a817ad7dd6" exitCode=60
Oct 30 22:00:21.123208 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.122853    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerDied","Data":"e787f3c0453274d11f25b01217effb53c2d452ed38274bfb74c926a817ad7dd6"}
Oct 30 22:00:21.123208 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.122942    5967 scope.go:122] "RemoveContainer" containerID="34faf33096d5831896b1da6a432f64a87804b5a9fcdad9ee9d77f40847d25f47"
Oct 30 22:00:21.123333 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.123314    5967 scope.go:122] "RemoveContainer" containerID="e787f3c0453274d11f25b01217effb53c2d452ed38274bfb74c926a817ad7dd6"
Oct 30 22:00:21.123620 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:21.123599    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66_odh-ai-gateway-infra(278c5226-690a-46e9-8ba4-203700697b9e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" podUID="278c5226-690a-46e9-8ba4-203700697b9e"
Oct 30 22:00:21.243478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.243450    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:21.393755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.393728    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:21.454018 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.453990    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\" (UniqueName: \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\") pod \"fa851fc3-2bf7-4028-ae83-e45ca685994e\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") "
Oct 30 22:00:21.454176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.454093    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\") pod \"fa851fc3-2bf7-4028-ae83-e45ca685994e\" (UID: \"fa851fc3-2bf7-4028-ae83-e45ca685994e\") "
Oct 30 22:00:21.454495 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.454469    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca" pod "fa851fc3-2bf7-4028-ae83-e45ca685994e" (UID: "fa851fc3-2bf7-4028-ae83-e45ca685994e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:21.456352 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.456326    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts" pod "fa851fc3-2bf7-4028-ae83-e45ca685994e" (UID: "fa851fc3-2bf7-4028-ae83-e45ca685994e"). InnerVolumeSpecName "kube-api-access-gh4ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:21.555741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.555709    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa851fc3-2bf7-4028-ae83-e45ca685994e-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.555741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:21.555737    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh4ts\" (UniqueName: \"kubernetes.io/projected/fa851fc3-2bf7-4028-ae83-e45ca685994e-kube-api-access-gh4ts\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:22.128923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.128839    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"
Oct 30 22:00:22.128923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.128862    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt" event={"ID":"fa851fc3-2bf7-4028-ae83-e45ca685994e","Type":"ContainerDied","Data":"966939fea3bccdb5e94d8f52ece749ab6a00228ba681c8f16f9adaa2285ccfcb"}
Oct 30 22:00:22.129438 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.128928    5967 scope.go:122] "RemoveContainer" containerID="5ff556f5e4a9008e6a88443365b92c665128937d09cffdd79d89b3166e2bcb03"
Oct 30 22:00:22.132893 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.132870    5967 generic.go:356] "Generic (PLEG): container finished" podID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerID="90241fbe56a7dd810f3229cdd0a6eacf821c19b946d8613027c7ec2e79a6c03a" exitCode=60
Oct 30 22:00:22.133028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.132903    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerDied","Data":"90241fbe56a7dd810f3229cdd0a6eacf821c19b946d8613027c7ec2e79a6c03a"}
Oct 30 22:00:22.133271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.133256    5967 scope.go:122] "RemoveContainer" containerID="90241fbe56a7dd810f3229cdd0a6eacf821c19b946d8613027c7ec2e79a6c03a"
Oct 30 22:00:22.133548 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:22.133528    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj_odh-ai-gateway-infra(c6c4d61e-0b13-4e80-8422-1ab1112dea95)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95"
Oct 30 22:00:22.138059 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.138042    5967 scope.go:122] "RemoveContainer" containerID="de9200424e77ac72965966d38ea0df9ec44887ba7a423807f521684e0128174c"
Oct 30 22:00:22.247971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.247926    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:22.293860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.293825    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:22.301439 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.301410    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-7df73b-29889960-nvmrt"]
Oct 30 22:00:22.385891 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.385821    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:22.463849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.463817    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\" (UniqueName: \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\") pod \"278c5226-690a-46e9-8ba4-203700697b9e\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") "
Oct 30 22:00:22.464027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.463874    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\") pod \"278c5226-690a-46e9-8ba4-203700697b9e\" (UID: \"278c5226-690a-46e9-8ba4-203700697b9e\") "
Oct 30 22:00:22.464341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.464300    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca" pod "278c5226-690a-46e9-8ba4-203700697b9e" (UID: "278c5226-690a-46e9-8ba4-203700697b9e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:22.466162 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.466133    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj" pod "278c5226-690a-46e9-8ba4-203700697b9e" (UID: "278c5226-690a-46e9-8ba4-203700697b9e"). InnerVolumeSpecName "kube-api-access-88grj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:22.565671 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.565636    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88grj\" (UniqueName: \"kubernetes.io/projected/278c5226-690a-46e9-8ba4-203700697b9e-kube-api-access-88grj\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:22.565671 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:22.565664    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278c5226-690a-46e9-8ba4-203700697b9e-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:23.140523 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.140494    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"
Oct 30 22:00:23.140523 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.140515    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66" event={"ID":"278c5226-690a-46e9-8ba4-203700697b9e","Type":"ContainerDied","Data":"124c306851cd863273e033aba5eceae13048fef413aab49315a5291a57f53bac"}
Oct 30 22:00:23.140994 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.140584    5967 scope.go:122] "RemoveContainer" containerID="e787f3c0453274d11f25b01217effb53c2d452ed38274bfb74c926a817ad7dd6"
Oct 30 22:00:23.304044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.304009    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:23.312748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.312721    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cef074-29889960-j5w66"]
Oct 30 22:00:23.424350 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.424265    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:23.571655 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.571629    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:23.677745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.677669    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\") pod \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") "
Oct 30 22:00:23.677745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.677720    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\" (UniqueName: \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\") pod \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\" (UID: \"c6c4d61e-0b13-4e80-8422-1ab1112dea95\") "
Oct 30 22:00:23.678023 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.678004    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca" pod "c6c4d61e-0b13-4e80-8422-1ab1112dea95" (UID: "c6c4d61e-0b13-4e80-8422-1ab1112dea95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:23.679956 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.679929    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk" pod "c6c4d61e-0b13-4e80-8422-1ab1112dea95" (UID: "c6c4d61e-0b13-4e80-8422-1ab1112dea95"). InnerVolumeSpecName "kube-api-access-d7wfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:23.779046 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.779014    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7wfk\" (UniqueName: \"kubernetes.io/projected/c6c4d61e-0b13-4e80-8422-1ab1112dea95-kube-api-access-d7wfk\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:23.779046 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:23.779042    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6c4d61e-0b13-4e80-8422-1ab1112dea95-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:24.017440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.017410    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="278c5226-690a-46e9-8ba4-203700697b9e" path="/var/lib/kubelet/pods/278c5226-690a-46e9-8ba4-203700697b9e/volumes"
Oct 30 22:00:24.017806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.017793    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" path="/var/lib/kubelet/pods/fa851fc3-2bf7-4028-ae83-e45ca685994e/volumes"
Oct 30 22:00:24.150005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.149968    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj" event={"ID":"c6c4d61e-0b13-4e80-8422-1ab1112dea95","Type":"ContainerDied","Data":"15030b183e36ec40d394033f73d5d75b3b43099955d40e6621b4005027042397"}
Oct 30 22:00:24.150495 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.150047    5967 scope.go:122] "RemoveContainer" containerID="90241fbe56a7dd810f3229cdd0a6eacf821c19b946d8613027c7ec2e79a6c03a"
Oct 30 22:00:24.150495 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.150058    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"
Oct 30 22:00:24.321196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.321114    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:24.370526 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:24.370497    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a7b06b-29889960-8d7mj"]
Oct 30 22:00:26.019805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.019767    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" path="/var/lib/kubelet/pods/c6c4d61e-0b13-4e80-8422-1ab1112dea95/volumes"
Oct 30 22:00:26.968322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968289    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:00:26.968800 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968781    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968801    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968819    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968826    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968856    5967 cpu_manager.go:414] "containerMap: removing container" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968864    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968878    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.968894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968885    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968897    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968904    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968920    5967 cpu_manager.go:414] "containerMap: removing container" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968927    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968941    5967 cpu_manager.go:414] "containerMap: removing container" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.968948    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969074    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969086    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969098    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969109    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969118    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="278c5226-690a-46e9-8ba4-203700697b9e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969125    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969137    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:26.969239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.969148    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:26.972549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:26.972528    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013131 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013100    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013139    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013231    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013489 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013399    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013489 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013460    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.013570 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.013489    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48qwc\" (UniqueName: \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.025342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.025310    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"premium-w2-b2f165-kserve-self-signed-certs\""
Oct 30 22:00:27.076108 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.076076    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:00:27.114874 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.114825    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115127 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.114900    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115127 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.114926    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48qwc\" (UniqueName: \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115127 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.114971    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115127 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.114993    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115127 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.115054    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.115569    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.115794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.115777    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.116360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.116325    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.118703 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.118679    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.119228 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.119205    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.177771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.177741    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48qwc\" (UniqueName: \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\") pod \"premium-w2-b2f165-kserve-58465fd95b-lnd9p\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") " pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.284479 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.284353    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:27.672760 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:27.672695    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:00:27.675481 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:27.675452    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod470ec18e_a5d8_4048_94d9_2d01d26a1866.slice/crio-135aeaf789f056a04e1b65a51e9393d84710ab5a3b2a7c1c8da7da2c6c684db9 WatchSource:0}: Error finding container 135aeaf789f056a04e1b65a51e9393d84710ab5a3b2a7c1c8da7da2c6c684db9: Status 404 returned error can't find the container with id 135aeaf789f056a04e1b65a51e9393d84710ab5a3b2a7c1c8da7da2c6c684db9
Oct 30 22:00:28.176744 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:28.176709    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" event={"ID":"470ec18e-a5d8-4048-94d9-2d01d26a1866","Type":"ContainerStarted","Data":"dc6a884ef5d9cd1b2db099bc94a1f1bb065b7c287dcda6102dfb9249a0463371"}
Oct 30 22:00:28.176744 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:28.176751    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" event={"ID":"470ec18e-a5d8-4048-94d9-2d01d26a1866","Type":"ContainerStarted","Data":"135aeaf789f056a04e1b65a51e9393d84710ab5a3b2a7c1c8da7da2c6c684db9"}
Oct 30 22:00:28.285359 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:28.285330    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:28.294712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:28.294644    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podStartSLOduration=2.294625628 podStartE2EDuration="2.294625628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:28.293532427 +0000 UTC m=+916.408240782" watchObservedRunningTime="2026-10-30 22:00:28.294625628 +0000 UTC m=+916.409333980"
Oct 30 22:00:35.591957 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:00:35.591913    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:00:37.284936 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:37.284903    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:37.298106 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:37.298081    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:38.241890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:38.241850    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:00:50.817291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817252    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:00:50.817733 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817720    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:50.817776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817735    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6c4d61e-0b13-4e80-8422-1ab1112dea95" containerName="cleanup"
Oct 30 22:00:50.817776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817771    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:50.817843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817776    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:50.817875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.817848    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa851fc3-2bf7-4028-ae83-e45ca685994e" containerName="cleanup"
Oct 30 22:00:50.821020 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.821006    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.867611 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867580    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.867797 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867628    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.867797 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867756    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.867905 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867804    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.867905 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867864    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.868002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.867927    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcgdn\" (UniqueName: \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.877627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.877587    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-bf7cbf\"/\"kube-root-ca.crt\""
Oct 30 22:00:50.923256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.923223    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-bf7cbf\"/\"default-dockercfg-z2crq\""
Oct 30 22:00:50.923256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.923242    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-bf7cbf\"/\"simulator-w1-bf7cbf-kserve-self-signed-certs\""
Oct 30 22:00:50.923256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.923223    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-bf7cbf\"/\"openshift-service-ca.crt\""
Oct 30 22:00:50.924911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.924892    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968495    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcgdn\" (UniqueName: \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968567    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968603    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968651    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968698    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.968741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.968727    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.969194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.969163    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.969194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.969178    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.969548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.969524    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.971619 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.971593    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:50.971836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:50.971821    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:51.030493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:51.030453    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcgdn\" (UniqueName: \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\") pod \"simulator-w1-bf7cbf-kserve-7778f7c778-lplqt\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") " pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:51.133617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:51.133524    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:00:51.518255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:51.518231    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:00:51.521098 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:00:51.521075    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b974ae9_6130_4dc1_aaed_7ceaccb377c1.slice/crio-aa233a3c9b00a72a3755f7370e84cb92be5c4bbad251f180c2ed8ebd78e45f79 WatchSource:0}: Error finding container aa233a3c9b00a72a3755f7370e84cb92be5c4bbad251f180c2ed8ebd78e45f79: Status 404 returned error can't find the container with id aa233a3c9b00a72a3755f7370e84cb92be5c4bbad251f180c2ed8ebd78e45f79
Oct 30 22:00:52.307074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:52.307034    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" event={"ID":"2b974ae9-6130-4dc1-aaed-7ceaccb377c1","Type":"ContainerStarted","Data":"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"}
Oct 30 22:00:52.307074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:52.307082    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" event={"ID":"2b974ae9-6130-4dc1-aaed-7ceaccb377c1","Type":"ContainerStarted","Data":"aa233a3c9b00a72a3755f7370e84cb92be5c4bbad251f180c2ed8ebd78e45f79"}
Oct 30 22:00:52.437259 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:52.437200    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podStartSLOduration=2.437186123 podStartE2EDuration="2.437186123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:52.436715242 +0000 UTC m=+940.551423595" watchObservedRunningTime="2026-10-30 22:00:52.437186123 +0000 UTC m=+940.551894473"
Oct 30 22:00:53.134655 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:00:53.134624    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:01:01.134154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:01.134122    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:01:01.146403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:01.146365    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:01:01.362806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:01.362782    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:01:05.592469 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:01:05.592434    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:01:07.647651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.647618    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:01:07.651586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.651561    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735016 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.734986    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.735055    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.735158    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j476p\" (UniqueName: \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.735293    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735361 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.735346    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.735447 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.735435    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.753459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.753434    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-a7b06b\"/\"premium-w5-a7b06b-kserve-self-signed-certs\""
Oct 30 22:01:07.755156 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.755137    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:01:07.836054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836010    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836048    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j476p\" (UniqueName: \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836092    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836120    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836135    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836185    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836584 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836558    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836628 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836591    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.836662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.836599    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.838613 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.838596    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.838915 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.838900    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.897765 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.897699    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j476p\" (UniqueName: \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\") pod \"premium-w5-a7b06b-kserve-7767cdc59f-54gg2\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") " pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:07.965586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:07.965555    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:08.357429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:08.357389    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:01:08.360926 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:01:08.360896    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde8fb258_289f_4af8_bba0_77330ff92732.slice/crio-bd351b0d204be938c2b518a6f6f8e0a8cec7ed15282e785191b536be9c95d46e WatchSource:0}: Error finding container bd351b0d204be938c2b518a6f6f8e0a8cec7ed15282e785191b536be9c95d46e: Status 404 returned error can't find the container with id bd351b0d204be938c2b518a6f6f8e0a8cec7ed15282e785191b536be9c95d46e
Oct 30 22:01:08.387925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:08.387900    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" event={"ID":"de8fb258-289f-4af8-bba0-77330ff92732","Type":"ContainerStarted","Data":"bd351b0d204be938c2b518a6f6f8e0a8cec7ed15282e785191b536be9c95d46e"}
Oct 30 22:01:09.394663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:09.394622    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" event={"ID":"de8fb258-289f-4af8-bba0-77330ff92732","Type":"ContainerStarted","Data":"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"}
Oct 30 22:01:09.514537 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:09.514475    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podStartSLOduration=2.51445738 podStartE2EDuration="2.51445738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:09.513934479 +0000 UTC m=+957.628642831" watchObservedRunningTime="2026-10-30 22:01:09.51445738 +0000 UTC m=+957.629165731"
Oct 30 22:01:09.966063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:09.966028    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:17.966426 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:17.966392    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:17.985959 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:17.985932    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:18.451072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:18.450989    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:01:35.593084 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:01:35.593048    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:01:42.904110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.904068    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:01:42.908149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.908121    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.960823 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.960787    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b2f165-openshift-default-dockercfg-5fv84\""
Oct 30 22:01:42.997055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997013    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997053    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997073    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gfd\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997187    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997264    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997311    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997420    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997446    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:42.997524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:42.997486    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.013357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.013318    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:01:43.098946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.098901    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.098983    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099093    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099125    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099152    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gfd\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099196    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099248    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099288    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099623 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099499    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099623 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099513    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099677    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099754    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.099896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.099783    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.100233 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.100216    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.101708 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.101683    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.102110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.102088    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.161884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.161772    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.161884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.161799    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gfd\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.221332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.221288    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:43.656985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.656957    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:01:43.659242 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:01:43.659214    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9d86bf_c0ee_477a_b1c0_b1d31b6e4e45.slice/crio-0221eb876df852cd1af482f9bbfd1eb6a242e3ca18421e52be54075b76150242 WatchSource:0}: Error finding container 0221eb876df852cd1af482f9bbfd1eb6a242e3ca18421e52be54075b76150242: Status 404 returned error can't find the container with id 0221eb876df852cd1af482f9bbfd1eb6a242e3ca18421e52be54075b76150242
Oct 30 22:01:43.661627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.661590    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:01:43.661712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.661659    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:01:43.661712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:43.661694    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:01:44.579056 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:44.579015    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" event={"ID":"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45","Type":"ContainerStarted","Data":"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"}
Oct 30 22:01:44.579580 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:44.579072    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" event={"ID":"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45","Type":"ContainerStarted","Data":"0221eb876df852cd1af482f9bbfd1eb6a242e3ca18421e52be54075b76150242"}
Oct 30 22:01:44.752887 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:44.752837    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podStartSLOduration=2.752822556 podStartE2EDuration="2.752822556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:44.751765531 +0000 UTC m=+992.866473882" watchObservedRunningTime="2026-10-30 22:01:44.752822556 +0000 UTC m=+992.867530907"
Oct 30 22:01:45.221752 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:45.221710    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:45.223065 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:45.223037    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 22:01:45.223199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:45.223089    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 22:01:46.221817 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:46.221780    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 22:01:46.222340 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:46.221849    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 22:01:47.221934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:47.221891    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 22:01:47.222333 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:47.221954    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 22:01:48.222593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:48.222562    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 22:01:48.222983 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:48.222616    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 22:01:49.222575 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:49.222538    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Oct 30 22:01:49.222761 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:49.222604    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Oct 30 22:01:50.301595 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:50.301560    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:50.302066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:50.301940    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:01:50.302826 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:01:50.302804    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:02:05.599656 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:02:05.599617    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:02:27.199015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.198979    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:02:27.202772 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.202756    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290116    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290348 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290289    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290348 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290318    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290469 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290450    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2nf\" (UniqueName: \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290506 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290492    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.290553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.290520    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.304785 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.304755    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-bf7cbf\"/\"premium-w1-bf7cbf-kserve-self-signed-certs\""
Oct 30 22:02:27.307257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.307238    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:02:27.391946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.391911    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.391947    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392082    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2nf\" (UniqueName: \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392124    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392148    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392364 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392221    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392366    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392602 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392567    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.392891 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.392625    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.394437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.394414    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.394823 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.394805    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.453625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.453555    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2nf\" (UniqueName: \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\") pod \"premium-w1-bf7cbf-kserve-76b8758cb7-dq27c\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") " pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.514544 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.514509    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:27.899293 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:27.899216    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:02:27.901812 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:02:27.901780    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1716a902_5d8d_4418_a2d6_5f80127b91b3.slice/crio-d5ae921f2e25b85f876f3b73b9be629c5e81078b0de17cb291a0e1dc68f8afdb WatchSource:0}: Error finding container d5ae921f2e25b85f876f3b73b9be629c5e81078b0de17cb291a0e1dc68f8afdb: Status 404 returned error can't find the container with id d5ae921f2e25b85f876f3b73b9be629c5e81078b0de17cb291a0e1dc68f8afdb
Oct 30 22:02:28.846613 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:28.846577    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" event={"ID":"1716a902-5d8d-4418-a2d6-5f80127b91b3","Type":"ContainerStarted","Data":"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"}
Oct 30 22:02:28.846999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:28.846622    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" event={"ID":"1716a902-5d8d-4418-a2d6-5f80127b91b3","Type":"ContainerStarted","Data":"d5ae921f2e25b85f876f3b73b9be629c5e81078b0de17cb291a0e1dc68f8afdb"}
Oct 30 22:02:28.900159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:28.900123    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:02:28.904342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:28.904320    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:28.957392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:28.957341    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-a7b06b-openshift-default-dockercfg-2f8cv\""
Oct 30 22:02:29.008095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.008068    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:02:29.013636 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.013572    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podStartSLOduration=2.013555028 podStartE2EDuration="2.013555028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:29.01332713 +0000 UTC m=+1037.128035481" watchObservedRunningTime="2026-10-30 22:02:29.013555028 +0000 UTC m=+1037.128263378"
Oct 30 22:02:29.014149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014111    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014188    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014259    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014432 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014281    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014432 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014337    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckx8g\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014537 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014434    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.014537 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.014487    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.015061 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.015040    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.015160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.015069    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.116692 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.116617    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.116848 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.116819    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.116933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.116861    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117045    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117149    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117161    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117281    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117349    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117408    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117458    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckx8g\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117592 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117531    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117625    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117753 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117732    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.117886 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.117865    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.119619 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.119598    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.119720 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.119658    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.179630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.179589    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.180120 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.180101    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckx8g\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.217879 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.217852    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:29.514850 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.514821    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:29.647245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.647222    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:02:29.649232 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:02:29.649197    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2308488f_4fe6_47f0_b6fb_d1e0d0d6d3ec.slice/crio-25922652291f49f9a34f16ff64eb417f2ed64c53821d811aee2fd9fc9b1373ec WatchSource:0}: Error finding container 25922652291f49f9a34f16ff64eb417f2ed64c53821d811aee2fd9fc9b1373ec: Status 404 returned error can't find the container with id 25922652291f49f9a34f16ff64eb417f2ed64c53821d811aee2fd9fc9b1373ec
Oct 30 22:02:29.652176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.652141    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:02:29.652267 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.652208    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:02:29.652267 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.652234    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:02:29.855160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.855078    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" event={"ID":"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec","Type":"ContainerStarted","Data":"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"}
Oct 30 22:02:29.855160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.855141    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" event={"ID":"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec","Type":"ContainerStarted","Data":"25922652291f49f9a34f16ff64eb417f2ed64c53821d811aee2fd9fc9b1373ec"}
Oct 30 22:02:29.978741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:29.978682    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podStartSLOduration=1.978661902 podStartE2EDuration="1.978661902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:29.97611718 +0000 UTC m=+1038.090825544" watchObservedRunningTime="2026-10-30 22:02:29.978661902 +0000 UTC m=+1038.093370256"
Oct 30 22:02:30.218065 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:30.218030    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:30.219436 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:30.219404    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:30.219556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:30.219466    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:31.218914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:31.218880    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:31.219303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:31.218934    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:32.218969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:32.218930    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:32.219362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:32.218985    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:33.218960 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:33.218929    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:33.219141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:33.218981    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:34.219067 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:34.219030    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:34.219244 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:34.219084    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:35.218965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:35.218924    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 22:02:35.219204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:35.218984    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 22:02:35.618481 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:02:35.618401    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:02:36.390259 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:36.390214    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:36.390919 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:36.390894    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:36.391812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:36.391784    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:02:37.514896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:37.514862    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:37.529190 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:37.529161    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:02:37.945693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:02:37.945616    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:03:05.594563 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:03:05.594520    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:03:35.593774 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:03:35.593737    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:04:05.593179 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:04:05.593074    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:04:14.987669 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:14.987631    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 22:04:14.988165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:14.987869    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy" containerID="cri-o://5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b" gracePeriod=30
Oct 30 22:04:20.236668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.236642    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 22:04:20.341114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341022    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341066    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341096    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341128    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341198    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341229    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341276    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341312    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341351    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.341749 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341457    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\") pod \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\" (UID: \"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a\") "
Oct 30 22:04:20.341749 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341468    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.341749 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341664    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:20.341968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.341769    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.342170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342079    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.342353 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342232    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.342353 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342253    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.342353 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342270    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.342353 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342284    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.342353 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.342298    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.343694 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.343671    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:20.343796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.343709    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "kube-api-access-xgwmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.343796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.343771    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.343870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.343811    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token" pod "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" (UID: "5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.443204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.443167    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.443204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.443202    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgwmk\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-kube-api-access-xgwmk\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.443431 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.443219    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.443431 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.443232    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.467325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.467288    5967 generic.go:356] "Generic (PLEG): container finished" podID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerID="5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b" exitCode=0
Oct 30 22:04:20.467494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.467348    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"
Oct 30 22:04:20.467494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.467363    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" event={"ID":"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a","Type":"ContainerDied","Data":"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"}
Oct 30 22:04:20.467494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.467436    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8" event={"ID":"5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a","Type":"ContainerDied","Data":"a750094196071fbf304aed7805a573c67f190ef821f43dc28e001e213a677fb9"}
Oct 30 22:04:20.467494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.467465    5967 scope.go:122] "RemoveContainer" containerID="5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"
Oct 30 22:04:20.478752 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.478730    5967 scope.go:122] "RemoveContainer" containerID="5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"
Oct 30 22:04:20.479118 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:04:20.479092    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b\": container with ID starting with 5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b not found: ID does not exist" containerID="5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"
Oct 30 22:04:20.479203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.479131    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b"} err="failed to get container status \"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b\": rpc error: code = NotFound desc = could not find container \"5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b\": container with ID starting with 5c9ffa0bf1a99aed712f336c261ea6d1b2098bae2dfb575bf6220b35a8d19c4b not found: ID does not exist"
Oct 30 22:04:20.635195 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.635110    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 22:04:20.641429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:20.641394    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5pb8"]
Oct 30 22:04:22.021052 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:22.021020    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" path="/var/lib/kubelet/pods/5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a/volumes"
Oct 30 22:04:35.593900 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:04:35.593862    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:04:44.574643 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.574609    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:04:44.575166 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.575142    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy"
Oct 30 22:04:44.575166 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.575162    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy"
Oct 30 22:04:44.575448 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.575263    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5962f24a-1ac2-4dd0-b44b-f92a5ec8cc8a" containerName="istio-proxy"
Oct 30 22:04:44.578643 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.578625    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.603972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.603940    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.603994    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604096    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604143    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604165    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604257    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604312 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604281    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpb9c\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604312 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604304    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.604455 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.604437    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.630774 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.630753    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7df73b-openshift-default-dockercfg-r7qb2\""
Oct 30 22:04:44.683746 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.683718    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:04:44.705140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705107    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705154    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705183    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705207    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705239    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705270    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpb9c\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705306    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705362    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705466    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705636    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705683    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705878 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705829    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.705998 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.705970    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.706229 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.706208    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.707767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.707742    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.707865 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.707802    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.766743 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.766710    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.766902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.766761    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpb9c\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:44.891267 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:44.891179    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:45.321132 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.321109    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:04:45.323552 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:04:45.323524    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa163a9_849a_4820_990a_b8d1e42d1faa.slice/crio-caaa4c4cdfc36b75e97e3df9f46869b13db4eec4afba1d3dc8c72349653957d8 WatchSource:0}: Error finding container caaa4c4cdfc36b75e97e3df9f46869b13db4eec4afba1d3dc8c72349653957d8: Status 404 returned error can't find the container with id caaa4c4cdfc36b75e97e3df9f46869b13db4eec4afba1d3dc8c72349653957d8
Oct 30 22:04:45.325859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.325828    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:04:45.325936 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.325892    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:04:45.325936 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.325922    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:04:45.605126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.605032    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" event={"ID":"ffa163a9-849a-4820-990a-b8d1e42d1faa","Type":"ContainerStarted","Data":"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"}
Oct 30 22:04:45.605126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.605088    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" event={"ID":"ffa163a9-849a-4820-990a-b8d1e42d1faa","Type":"ContainerStarted","Data":"caaa4c4cdfc36b75e97e3df9f46869b13db4eec4afba1d3dc8c72349653957d8"}
Oct 30 22:04:45.726205 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.726157    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podStartSLOduration=1.726140455 podStartE2EDuration="1.726140455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:45.72525227 +0000 UTC m=+1173.839960633" watchObservedRunningTime="2026-10-30 22:04:45.726140455 +0000 UTC m=+1173.840848806"
Oct 30 22:04:45.891530 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:45.891443    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:46.904399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:46.893914    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:46.904399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:46.893976    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:47.894425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:47.894392    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:47.894690 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:47.894663    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:48.897396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:48.895668    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:48.897396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:48.895731    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:49.903398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:49.898815    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:49.903398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:49.898882    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:50.892398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:50.891692    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:50.892398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:50.891753    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:51.892206 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:51.892127    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 22:04:51.892206 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:51.892193    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 22:04:52.896790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:52.896762    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:52.897195 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:52.897035    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:52.897669 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:52.897654    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:04:57.086485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.086453    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:04:57.090247 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.090228    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.138811 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.138784    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.138988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.138825    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.138988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.138905    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.139116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.138995    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.139116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.139024    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.139116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.139052    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnvkc\" (UniqueName: \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.192767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.192733    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-cef074\"/\"default-dockercfg-4nxhw\""
Oct 30 22:04:57.192767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.192741    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-cef074\"/\"distinct-w3-cef074-kserve-self-signed-certs\""
Oct 30 22:04:57.192968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.192780    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-cef074\"/\"kube-root-ca.crt\""
Oct 30 22:04:57.192968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.192838    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-cef074\"/\"openshift-service-ca.crt\""
Oct 30 22:04:57.194629 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.194610    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:04:57.240013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.239982    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240041    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240083    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnvkc\" (UniqueName: \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240227    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240279    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240353    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240414    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240649    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.240672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.240664    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.242560 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.242538    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.242963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.242943    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.301389 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.301337    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnvkc\" (UniqueName: \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\") pod \"distinct-w3-cef074-kserve-7c9fd7d575-pg8fl\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.402955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.402862    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:04:57.801334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:57.801294    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:04:57.803826 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:04:57.803800    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38055ab8_0c2f_483a_ad13_4502b10326cb.slice/crio-b1039c9ab2c6c19b487dd1ff8955dd092ab1a8bd30c9d59b480519474a350590 WatchSource:0}: Error finding container b1039c9ab2c6c19b487dd1ff8955dd092ab1a8bd30c9d59b480519474a350590: Status 404 returned error can't find the container with id b1039c9ab2c6c19b487dd1ff8955dd092ab1a8bd30c9d59b480519474a350590
Oct 30 22:04:58.695542 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:58.692428    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" event={"ID":"38055ab8-0c2f-483a-ad13-4502b10326cb","Type":"ContainerStarted","Data":"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"}
Oct 30 22:04:58.695542 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:58.692485    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" event={"ID":"38055ab8-0c2f-483a-ad13-4502b10326cb","Type":"ContainerStarted","Data":"b1039c9ab2c6c19b487dd1ff8955dd092ab1a8bd30c9d59b480519474a350590"}
Oct 30 22:04:58.811490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:58.811444    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podStartSLOduration=1.8114296479999998 podStartE2EDuration="1.811429648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:58.810050645 +0000 UTC m=+1186.924758995" watchObservedRunningTime="2026-10-30 22:04:58.811429648 +0000 UTC m=+1186.926137999"
Oct 30 22:04:59.403095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:04:59.403055    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:05:00.349552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:00.349521    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 22:05:00.349956 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:00.349787    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy" containerID="cri-o://56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5" gracePeriod=30
Oct 30 22:05:05.593219 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:05:05.593180    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:05:05.606831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.606800    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 22:05:05.731673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.731643    5967 generic.go:356] "Generic (PLEG): container finished" podID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerID="56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5" exitCode=0
Oct 30 22:05:05.731851 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.731690    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"
Oct 30 22:05:05.731851 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.731709    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" event={"ID":"c3653d62-19e8-4939-b9f6-bf2d2ed312f9","Type":"ContainerDied","Data":"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"}
Oct 30 22:05:05.731851 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.731778    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq" event={"ID":"c3653d62-19e8-4939-b9f6-bf2d2ed312f9","Type":"ContainerDied","Data":"7b57ef08efe87b9467daf6e88e2b7c4f8da533ccd9f1dc9842ee492250acf8a3"}
Oct 30 22:05:05.731851 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.731800    5967 scope.go:122] "RemoveContainer" containerID="56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"
Oct 30 22:05:05.738131 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738107    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738189    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738225    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738285    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738343    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738392    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738434    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738461    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738628 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738522    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\") pod \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\" (UID: \"c3653d62-19e8-4939-b9f6-bf2d2ed312f9\") "
Oct 30 22:05:05.738767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738737    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:05.739639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.738979    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.739639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.739090    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:05.739639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.739186    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:05:05.739639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.739257    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:05.739639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.739317    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:05.740878 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.740845    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:05:05.741156 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.741131    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "kube-api-access-xgpm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:05.741266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.741203    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:05.741535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.741515    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token" pod "c3653d62-19e8-4939-b9f6-bf2d2ed312f9" (UID: "c3653d62-19e8-4939-b9f6-bf2d2ed312f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:05.742315 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.742296    5967 scope.go:122] "RemoveContainer" containerID="56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"
Oct 30 22:05:05.742730 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:05:05.742705    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5\": container with ID starting with 56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5 not found: ID does not exist" containerID="56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"
Oct 30 22:05:05.742788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.742746    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5"} err="failed to get container status \"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5\": rpc error: code = NotFound desc = could not find container \"56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5\": container with ID starting with 56ae340c8e22a9df0c0400961212f398eb64da74a2bee291008771f5ac844da5 not found: ID does not exist"
Oct 30 22:05:05.840043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840009    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840038    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840048    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840057    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840066    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840076    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840084    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.840274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:05.840093    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgpm4\" (UniqueName: \"kubernetes.io/projected/c3653d62-19e8-4939-b9f6-bf2d2ed312f9-kube-api-access-xgpm4\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:06.147365 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:06.147335    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 22:05:06.153721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:06.153693    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qg5cq"]
Oct 30 22:05:07.404136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:07.404104    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:05:07.418220 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:07.418192    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:05:07.754073 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:07.754047    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:05:08.019236 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:08.019157    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" path="/var/lib/kubelet/pods/c3653d62-19e8-4939-b9f6-bf2d2ed312f9/volumes"
Oct 30 22:05:12.148214 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:12.148179    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:05:12.149503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:12.149480    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:05:26.286965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.286928    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:05:26.287621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.287552    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy"
Oct 30 22:05:26.287621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.287566    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy"
Oct 30 22:05:26.287783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.287663    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3653d62-19e8-4939-b9f6-bf2d2ed312f9" containerName="istio-proxy"
Oct 30 22:05:26.292417 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.292396    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.344968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.344922    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-cef074-openshift-default-dockercfg-vkbnc\""
Oct 30 22:05:26.373634 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373610    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373654    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373721    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvws2\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373755    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373880 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373780    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373880 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373870    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373947 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373900    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.373947 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.373924    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.374039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.374019    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.397228 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.397201    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:05:26.475346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475310    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475360    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475430    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475471    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvws2\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475513    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475536    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475604    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475647    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475687    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475954 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475895    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.475954 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475925    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.476055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.475977    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.476152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.476132    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.476521 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.476346    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.477996 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.477974    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.478096 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.478081    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.537630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.537552    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.537787 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.537761    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvws2\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-j2sds\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:26.608253 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:26.608200    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:27.048479 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.048451    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:05:27.048747 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:05:27.048720    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf911f710_3519_4eb1_844e_43ebca4a9a6c.slice/crio-e1fbbd8fb669fecdf315f6fd1f22cedc6dc771fb050e7fd469ce442f80cd69d7 WatchSource:0}: Error finding container e1fbbd8fb669fecdf315f6fd1f22cedc6dc771fb050e7fd469ce442f80cd69d7: Status 404 returned error can't find the container with id e1fbbd8fb669fecdf315f6fd1f22cedc6dc771fb050e7fd469ce442f80cd69d7
Oct 30 22:05:27.050993 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.050964    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:27.051063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.051033    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:27.051105 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.051061    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:27.856763 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.856731    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" event={"ID":"f911f710-3519-4eb1-844e-43ebca4a9a6c","Type":"ContainerStarted","Data":"9150c08ef86fb3035dee0239cd8ea06f669cbfa0b38f5e82cb83fc038e3d074e"}
Oct 30 22:05:27.857137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:27.856780    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" event={"ID":"f911f710-3519-4eb1-844e-43ebca4a9a6c","Type":"ContainerStarted","Data":"e1fbbd8fb669fecdf315f6fd1f22cedc6dc771fb050e7fd469ce442f80cd69d7"}
Oct 30 22:05:28.031073 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:28.031025    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podStartSLOduration=2.031012321 podStartE2EDuration="2.031012321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:28.028815007 +0000 UTC m=+1216.143523359" watchObservedRunningTime="2026-10-30 22:05:28.031012321 +0000 UTC m=+1216.145720736"
Oct 30 22:05:28.608855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:28.608818    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:28.610442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:28.610416    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:28.610516 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:28.610470    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:29.608889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:29.608852    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:29.609457 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:29.608920    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:30.608794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.608757    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:30.609132 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.609088    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:30.778513 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.778482    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:05:30.782246 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.782230    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.900452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.897771    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:05:30.900452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.897961    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-536975\"/\"default-dockercfg-mxbdq\""
Oct 30 22:05:30.900452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.898096    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-536975\"/\"distinct-w4-536975-kserve-self-signed-certs\""
Oct 30 22:05:30.900452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.898162    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-536975\"/\"openshift-service-ca.crt\""
Oct 30 22:05:30.900452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.898223    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-536975\"/\"kube-root-ca.crt\""
Oct 30 22:05:30.944208 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944167    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.944440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944258    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpbd\" (UniqueName: \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.944440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944334    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.944440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944413    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.944604 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944474    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:30.944604 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:30.944541    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.045881 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.045847    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.045913    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpbd\" (UniqueName: \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.045952    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.045973    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.046007    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.046061    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.046346    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.046576    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.046670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.046599    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.048788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.048752    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.049220 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.049197    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.112091 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.112051    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpbd\" (UniqueName: \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\") pod \"distinct-w4-536975-kserve-69c5f6f7d4-927ll\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") " pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.118835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.118795    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:31.542622 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.542595    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:05:31.545256 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:05:31.545232    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2161a16b_a2e9_46c5_9a32_37ee8e0d0c23.slice/crio-3a5d314df5778e9087cb804b5cc784029b4e0a1385b3514d2684baa4ea505ec8 WatchSource:0}: Error finding container 3a5d314df5778e9087cb804b5cc784029b4e0a1385b3514d2684baa4ea505ec8: Status 404 returned error can't find the container with id 3a5d314df5778e9087cb804b5cc784029b4e0a1385b3514d2684baa4ea505ec8
Oct 30 22:05:31.608895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.608863    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:31.609042 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.608920    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:31.909496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.909359    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" event={"ID":"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23","Type":"ContainerStarted","Data":"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"}
Oct 30 22:05:31.909496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:31.909459    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" event={"ID":"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23","Type":"ContainerStarted","Data":"3a5d314df5778e9087cb804b5cc784029b4e0a1385b3514d2684baa4ea505ec8"}
Oct 30 22:05:32.028258 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:32.028209    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podStartSLOduration=2.02819635 podStartE2EDuration="2.02819635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:32.02669874 +0000 UTC m=+1220.141407092" watchObservedRunningTime="2026-10-30 22:05:32.02819635 +0000 UTC m=+1220.142904701"
Oct 30 22:05:32.120225 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:32.120191    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:32.609021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:32.608982    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:32.609224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:32.609044    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:33.608595 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:33.608563    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:05:33.608997 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:33.608610    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 22:05:34.613627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:34.613598    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:34.614123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:34.613880    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:34.614908 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:34.614886    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:05:35.591919 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:05:35.591884    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:05:41.119796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:41.119760    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:41.132337 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:41.132310    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:41.977846 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:41.977820    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:05:54.405053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.405023    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:05:54.408835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.408819    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.461449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.461409    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-bf7cbf-openshift-default-dockercfg-7rlzz\""
Oct 30 22:05:54.514310 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.514273    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:05:54.518690 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.518658    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.518855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.518707    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.518855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.518742    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.518978 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.518890    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.519052 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.519036    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p45f6\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.519149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.519135    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.519198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.519167    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.519312 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.519292    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.519411 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.519389    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620185 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620147    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620203    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620227    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620252    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620273    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620389    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p45f6\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620461    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620489    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620537    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620619    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620679    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620951 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620863    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.620951 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.620917    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.621275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.621250    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.623135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.623115    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.623266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.623158    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.682645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.682537    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.682879 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.682817    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p45f6\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:54.723168 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:54.723135    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:55.155812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:55.155786    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:05:55.158229 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:05:55.158199    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cecd42f_0a32_4cf9_a9de_dbfbfdbd0ede.slice/crio-305b5d60ec111ba857ab8c1c2408a42db4fe9090b92c1be2c0fa6e2b53ab4ba4 WatchSource:0}: Error finding container 305b5d60ec111ba857ab8c1c2408a42db4fe9090b92c1be2c0fa6e2b53ab4ba4: Status 404 returned error can't find the container with id 305b5d60ec111ba857ab8c1c2408a42db4fe9090b92c1be2c0fa6e2b53ab4ba4
Oct 30 22:05:55.161188 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:55.161130    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:55.161321 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:55.161297    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:55.161471 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:55.161448    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:05:56.051540 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.051498    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" event={"ID":"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede","Type":"ContainerStarted","Data":"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"}
Oct 30 22:05:56.052055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.051568    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" event={"ID":"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede","Type":"ContainerStarted","Data":"305b5d60ec111ba857ab8c1c2408a42db4fe9090b92c1be2c0fa6e2b53ab4ba4"}
Oct 30 22:05:56.222794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.222744    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podStartSLOduration=2.222729839 podStartE2EDuration="2.222729839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:56.220695271 +0000 UTC m=+1244.335403623" watchObservedRunningTime="2026-10-30 22:05:56.222729839 +0000 UTC m=+1244.337438190"
Oct 30 22:05:56.724053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.724017    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:05:56.725458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.725419    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:05:56.725608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:56.725478    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:05:57.723852 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:57.723817    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:05:57.724305 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:57.723874    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:05:58.724265 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:58.724231    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:05:58.724688 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:58.724283    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:05:59.723687 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:59.723652    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:05:59.723871 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:05:59.723717    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:06:00.724002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:00.723967    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:06:00.724442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:00.724027    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:06:00.956788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:00.956752    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:06:00.960481 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:00.960464    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.062219 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.062144    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-536975-openshift-default-dockercfg-xkvs2\""
Oct 30 22:06:01.065191 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.065162    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:06:01.123295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123258    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123345    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123463    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123498    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123706 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123583    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123706 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123637    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbp2\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123771    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123820    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.123984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.123965    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225710 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225677    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225726    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225758    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225785    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225819    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.225907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.225851    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbp2\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226131    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226186    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226137    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226241    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226257    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226541    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226738    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.226819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.226800    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.228415 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.228392    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.228664 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.228643    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.287068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.287032    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.287210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.287100    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbp2\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.574591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.574552    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:01.723419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.723365    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 22:06:01.723592 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:01.723436    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 22:06:02.006658 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.006402    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:06:02.009782 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:06:02.009752    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3c1601_fe9b_44cd_9ba7_559e3a1f8fad.slice/crio-25fb7cec27b5cfa69b80ece4deb45920b64a0fe11c83f18be9c5ca946cf6e452 WatchSource:0}: Error finding container 25fb7cec27b5cfa69b80ece4deb45920b64a0fe11c83f18be9c5ca946cf6e452: Status 404 returned error can't find the container with id 25fb7cec27b5cfa69b80ece4deb45920b64a0fe11c83f18be9c5ca946cf6e452
Oct 30 22:06:02.015477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.015444    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:02.015598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.015507    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:02.015598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.015536    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:02.089021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.088978    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" event={"ID":"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad","Type":"ContainerStarted","Data":"e71bfef8e34dc2c9d60f5825c14d74ed81dd550a5cada96af9e5d6aeb18b428b"}
Oct 30 22:06:02.089217 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.089044    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" event={"ID":"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad","Type":"ContainerStarted","Data":"25fb7cec27b5cfa69b80ece4deb45920b64a0fe11c83f18be9c5ca946cf6e452"}
Oct 30 22:06:02.209708 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.209649    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podStartSLOduration=2.209631851 podStartE2EDuration="2.209631851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:02.208852658 +0000 UTC m=+1250.323561047" watchObservedRunningTime="2026-10-30 22:06:02.209631851 +0000 UTC m=+1250.324340204"
Oct 30 22:06:02.575260 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.575231    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:02.728290 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.728259    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:06:02.728633 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.728616    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:06:02.729395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:02.729356    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:06:03.577104 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:03.577066    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:03.577593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:03.577126    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:04.575868 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:04.575829    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:04.576066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:04.575899    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:05.575433 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:05.575391    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:05.575931 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:05.575463    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:05.632849 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:06:05.632812    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:06:06.575638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:06.575603    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:06.576024 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:06.575660    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:07.575856 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:07.575824    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:07.576240 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:07.575877    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:08.575574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:08.575527    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:06:08.575761 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:08.575603    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Oct 30 22:06:09.579913 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:09.579883    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:09.580427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:09.580410    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:09.581207 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:09.581184    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:06:30.137843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.137798    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:06:30.143458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.143433    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.228768 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.228723    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.228962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.228854    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.228962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.228920    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.228962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.228940    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5tk\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.229165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.229027    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.229165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.229091    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.229165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.229115    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.229338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.229233    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.229338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.229270    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.248414 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.248383    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:06:30.330520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330484    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330525    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5tk\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330564    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330619    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330647    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330702    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.330781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330722    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330825    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.330903    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.331109    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.331171    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331264 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.331249    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.331324    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.331429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.331329    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.333109 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.333081    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.333481 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.333461    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.392585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.392509    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.392832 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.392812    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5tk\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.459062 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.459033    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:30.898579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.898550    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:06:30.900629 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:06:30.900597    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64de9a53_4eb6_49fa_9d53_2e0da8b9fbbd.slice/crio-b2aa932ac8c14a2a02627d9ff028e14b799c04ffe60bc73a14db3cd6754b6594 WatchSource:0}: Error finding container b2aa932ac8c14a2a02627d9ff028e14b799c04ffe60bc73a14db3cd6754b6594: Status 404 returned error can't find the container with id b2aa932ac8c14a2a02627d9ff028e14b799c04ffe60bc73a14db3cd6754b6594
Oct 30 22:06:30.903191 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.903158    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:30.903252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.903227    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:30.903287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:30.903260    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:06:31.334442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.334402    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" event={"ID":"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd","Type":"ContainerStarted","Data":"3539a61004bb1e4fc50780adb5e4306a86663867169443fb4c2665c271c13af3"}
Oct 30 22:06:31.334888 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.334469    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" event={"ID":"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd","Type":"ContainerStarted","Data":"b2aa932ac8c14a2a02627d9ff028e14b799c04ffe60bc73a14db3cd6754b6594"}
Oct 30 22:06:31.459325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.459292    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:31.460937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.460912    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:31.461060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.460962    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:31.491393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:31.484415    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podStartSLOduration=1.484396121 podStartE2EDuration="1.484396121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:31.481967367 +0000 UTC m=+1279.596675718" watchObservedRunningTime="2026-10-30 22:06:31.484396121 +0000 UTC m=+1279.599104477"
Oct 30 22:06:32.459679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:32.459638    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:32.460177 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:32.459693    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:33.459644 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:33.459608    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:33.459822 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:33.459664    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:34.459837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:34.459799    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:34.460257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:34.459883    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:35.459739 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:35.459702    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:35.459998 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:35.459772    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:35.618596 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:06:35.618565    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:06:36.459620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:36.459588    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:06:36.459879 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:36.459646    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 22:06:37.774543 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:37.774507    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:37.775042 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:37.774977    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:37.776009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:37.775983    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:06:46.353003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.352964    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:06:46.358503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.358478    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437016    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437160    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zw2\" (UniqueName: \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437263 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437249    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437277    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437357 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437342    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.437418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.437385    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.472204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.472171    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-cef074\"/\"distinct-2-w3-cef074-kserve-self-signed-certs\""
Oct 30 22:06:46.475823 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.475793    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:06:46.538460 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538428    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zw2\" (UniqueName: \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538510    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538545    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538597    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538622    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538887 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538714    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.538961 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538937    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.539026 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.538955    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.539082 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.539045    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.541074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.541050    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.541288 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.541270    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.600614 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.600580    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zw2\" (UniqueName: \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\") pod \"distinct-2-w3-cef074-kserve-c66c68768-62lpz\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") " pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:46.672231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:46.672156    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:47.060263 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:47.060240    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:06:47.062422 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:06:47.062397    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeedca670_799e_4929_95cc_2661490cca66.slice/crio-90b8925ced69dbaefb51ec028d73b7ed20527f5b2c6b844d9a46b770f4a2084f WatchSource:0}: Error finding container 90b8925ced69dbaefb51ec028d73b7ed20527f5b2c6b844d9a46b770f4a2084f: Status 404 returned error can't find the container with id 90b8925ced69dbaefb51ec028d73b7ed20527f5b2c6b844d9a46b770f4a2084f
Oct 30 22:06:47.424862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:47.424764    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" event={"ID":"eedca670-799e-4929-95cc-2661490cca66","Type":"ContainerStarted","Data":"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"}
Oct 30 22:06:47.424862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:47.424812    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" event={"ID":"eedca670-799e-4929-95cc-2661490cca66","Type":"ContainerStarted","Data":"90b8925ced69dbaefb51ec028d73b7ed20527f5b2c6b844d9a46b770f4a2084f"}
Oct 30 22:06:47.543264 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:47.543207    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podStartSLOduration=1.5431902549999998 podStartE2EDuration="1.543190255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:47.5423606 +0000 UTC m=+1295.657068952" watchObservedRunningTime="2026-10-30 22:06:47.543190255 +0000 UTC m=+1295.657898610"
Oct 30 22:06:47.672505 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:47.672472    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:56.672366 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:56.672329    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:56.692756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:56.692730    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:06:57.492576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:06:57.492543    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:07:01.044218 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.044174    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:07:01.050412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.050342    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.128864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.128814    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:07:01.216626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216574    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.216830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216664    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.216830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216693    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skpx\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.216830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216761    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.216830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216800    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.216830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216830    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.217122 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216929    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.217122 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216955    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.217122 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.216986    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318431    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318472    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318556    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318578    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318608    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318729    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318782    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318808    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skpx\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.318948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318870    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.319092 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.318991    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.319092 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.319063    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.319290 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.319267    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.319621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.319600    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.320144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.320104    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.321903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.321871    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.322013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.321964    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.380572 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.380540    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.380702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.380552    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skpx\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.671438 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.671326    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:01.696922 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.696895    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:07:01.701544 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.701521    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.754393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.753961    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-b9fbe2-openshift-default-dockercfg-jrtfd\""
Oct 30 22:07:01.764117 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.764089    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:07:01.825732 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.825702    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.825896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.825741    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.825896 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.825826    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.825971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.825902    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.826004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.825994    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9zfd\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.826038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.826030    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.826076 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.826062    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.826109 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.826092    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.826168 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.826157    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.926914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.926826    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.926914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.926871    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.926928    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.926956    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927057    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9zfd\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927110    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927166    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927216    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927280    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927531    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927770    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927797    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.927967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.927935    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.928358 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.928333    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.929983 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.929960    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.930086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.929994    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.988796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.988763    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:01.988925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:01.988891    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9zfd\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:02.017354 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.017326    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:02.118552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.118522    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:07:02.120159 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:07:02.120131    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b6b291_7c31_4779_afe1_ad4a6a7e1bdd.slice/crio-81809b4982e69d001fee4bd382fbf544ff484539d7e4f8ba8b66240a11c8aaa3 WatchSource:0}: Error finding container 81809b4982e69d001fee4bd382fbf544ff484539d7e4f8ba8b66240a11c8aaa3: Status 404 returned error can't find the container with id 81809b4982e69d001fee4bd382fbf544ff484539d7e4f8ba8b66240a11c8aaa3
Oct 30 22:07:02.123077 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.123037    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.123189 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.123105    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.123189 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.123131    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.399458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.399432    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:07:02.401569 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:07:02.401539    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54096256_ca0a_49be_919a_816ba85da6b1.slice/crio-68b769999f7e23adf4bdf457215ce29d9e678e3a63eb68506c527615ceaa6d08 WatchSource:0}: Error finding container 68b769999f7e23adf4bdf457215ce29d9e678e3a63eb68506c527615ceaa6d08: Status 404 returned error can't find the container with id 68b769999f7e23adf4bdf457215ce29d9e678e3a63eb68506c527615ceaa6d08
Oct 30 22:07:02.404294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.404255    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.404393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.404331    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.404393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.404364    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:02.515802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.515764    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" event={"ID":"54096256-ca0a-49be-919a-816ba85da6b1","Type":"ContainerStarted","Data":"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"}
Oct 30 22:07:02.515999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.515830    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" event={"ID":"54096256-ca0a-49be-919a-816ba85da6b1","Type":"ContainerStarted","Data":"68b769999f7e23adf4bdf457215ce29d9e678e3a63eb68506c527615ceaa6d08"}
Oct 30 22:07:02.517947 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.517916    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" event={"ID":"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd","Type":"ContainerStarted","Data":"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"}
Oct 30 22:07:02.518101 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.517971    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" event={"ID":"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd","Type":"ContainerStarted","Data":"81809b4982e69d001fee4bd382fbf544ff484539d7e4f8ba8b66240a11c8aaa3"}
Oct 30 22:07:02.642362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.642312    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podStartSLOduration=1.642293514 podStartE2EDuration="1.642293514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:02.640435184 +0000 UTC m=+1310.755143540" watchObservedRunningTime="2026-10-30 22:07:02.642293514 +0000 UTC m=+1310.757001864"
Oct 30 22:07:02.672419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.672389    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:02.767105 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:02.767044    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podStartSLOduration=2.767029042 podStartE2EDuration="2.767029042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:02.765118828 +0000 UTC m=+1310.879827189" watchObservedRunningTime="2026-10-30 22:07:02.767029042 +0000 UTC m=+1310.881737473"
Oct 30 22:07:03.019454 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:03.018725    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:03.021514 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:03.021162    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:03.021514 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:03.021216    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:03.673416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:03.673361    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:03.673878 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:03.673449    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:04.021397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:04.020798    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:04.021397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:04.020859    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:04.671813 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:04.671775    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:04.671995 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:04.671825    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:05.021931 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:05.021882    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:05.022478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:05.021953    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:05.638273 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:07:05.638239    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:07:05.672000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:05.671971    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:05.672145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:05.672022    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:06.033985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:06.033950    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:06.034542 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:06.034496    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:06.671837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:06.671796    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:06.672143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:06.671852    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:07.018459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:07.018425    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:07.018746 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:07.018719    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:07.671862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:07.671829    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:07.672256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:07.671885    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:08.032507 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:08.032473    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:08.032819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:08.032778    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:08.671968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:08.671928    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:08.672364 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:08.671994    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 22:07:09.017862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:09.017826    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:09.018152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:09.018117    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 22:07:09.677679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:09.677647    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:09.678632 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:09.678603    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:09.679295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:09.679278    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:07:10.022967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:10.022925    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:10.025016 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:10.024958    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:10.026179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:10.026155    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:07:26.296048 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.296013    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:07:26.301099 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.301073    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.385974    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386205 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386018    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386205 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386039    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386205 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386167    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrfm\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386247    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386282    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386307    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386409    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.386485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.386431    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.405290 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.405261    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:07:26.487553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487521    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487557    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487627    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487660    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487682    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487747    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrfm\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487977 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487834    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487977 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487884    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.487977 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.487930    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.488129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.488070    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.488129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.488105    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.488348 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.488314    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.488628 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.488610    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.488742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.488609    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.490441 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.490415    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.490953 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.490932    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.549284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.549221    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.549512 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.549489    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrfm\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-9rlgw\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:26.615221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:26.615187    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:27.044421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.044395    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:07:27.046298 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:07:27.046274    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784da18a_807b_4a3d_9c61_6d354ac6d000.slice/crio-ab28ed2de2442edc5b7d281c366d954f072437513bb1e93e56059583fa814b40 WatchSource:0}: Error finding container ab28ed2de2442edc5b7d281c366d954f072437513bb1e93e56059583fa814b40: Status 404 returned error can't find the container with id ab28ed2de2442edc5b7d281c366d954f072437513bb1e93e56059583fa814b40
Oct 30 22:07:27.048808 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.048770    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:27.048902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.048841    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:27.048902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.048870    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:07:27.713381 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.713329    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" event={"ID":"784da18a-807b-4a3d-9c61-6d354ac6d000","Type":"ContainerStarted","Data":"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"}
Oct 30 22:07:27.713796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.713410    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" event={"ID":"784da18a-807b-4a3d-9c61-6d354ac6d000","Type":"ContainerStarted","Data":"ab28ed2de2442edc5b7d281c366d954f072437513bb1e93e56059583fa814b40"}
Oct 30 22:07:27.935662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:27.935611    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podStartSLOduration=1.9355953860000001 podStartE2EDuration="1.935595386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:27.883532917 +0000 UTC m=+1335.998241269" watchObservedRunningTime="2026-10-30 22:07:27.935595386 +0000 UTC m=+1336.050303737"
Oct 30 22:07:28.615824 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:28.615780    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:28.617660 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:28.617629    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:28.617810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:28.617708    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:29.615909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:29.615868    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:29.616423 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:29.615926    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:30.615979 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:30.615943    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:30.616383 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:30.615999    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:31.616223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:31.616189    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:31.616702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:31.616241    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:32.616552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:32.616513    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:32.616958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:32.616566    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:33.615809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:33.615768    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 22:07:33.615992 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:33.615839    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 22:07:34.619748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:34.619720    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:34.620134 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:34.619991    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:34.620609 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:07:34.620588    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:07:35.593832 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:07:35.593793    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:08:05.602141 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:08:05.602098    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:08:07.627715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:07.627669    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podUID="7ff8f2bfa49239d9e2240c708e676d72" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:11.478165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.478133    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:08:11.482280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.482262    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.570786 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.570741    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.571007 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.570899    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.571007 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.570956    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.571139 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.571104    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.571215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.571156    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.571277 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.571236    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtbx\" (UniqueName: \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.584708 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.584671    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"distinct-2-w6-b9fbe2-kserve-self-signed-certs\""
Oct 30 22:08:11.586957 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.586930    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:08:11.672959 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.672916    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.672959 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.672959    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673076    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtbx\" (UniqueName: \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673329 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673309    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673483    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673530    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673549    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673554    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.673822 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.673800    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.676324 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.676296    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.677048 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.677028    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.735128 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.735057    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtbx\" (UniqueName: \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\") pod \"distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:11.795626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:11.795581    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:12.217286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:12.217263    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:08:12.219303 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:08:12.219280    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode08636c0_2ce2_469a_a1c8_5d2dc97770b6.slice/crio-c65b223b79cd10c8087045dd1c2f787495f37b1f0bac36554e85f738b16639cc WatchSource:0}: Error finding container c65b223b79cd10c8087045dd1c2f787495f37b1f0bac36554e85f738b16639cc: Status 404 returned error can't find the container with id c65b223b79cd10c8087045dd1c2f787495f37b1f0bac36554e85f738b16639cc
Oct 30 22:08:13.002462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:13.002424    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" event={"ID":"e08636c0-2ce2-469a-a1c8-5d2dc97770b6","Type":"ContainerStarted","Data":"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"}
Oct 30 22:08:13.002923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:13.002472    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" event={"ID":"e08636c0-2ce2-469a-a1c8-5d2dc97770b6","Type":"ContainerStarted","Data":"c65b223b79cd10c8087045dd1c2f787495f37b1f0bac36554e85f738b16639cc"}
Oct 30 22:08:13.795955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:13.795920    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:21.796422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:21.796360    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:21.809447 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:21.809424    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:21.928815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:21.928770    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podStartSLOduration=10.928755499 podStartE2EDuration="10.928755499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:13.123212836 +0000 UTC m=+1381.237921188" watchObservedRunningTime="2026-10-30 22:08:21.928755499 +0000 UTC m=+1390.043463849"
Oct 30 22:08:22.067027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:22.066939    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:08:31.107233 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.107157    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:08:31.122094 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.122066    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.228790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.228738    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.228988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.228801    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.228988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.228857    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.228988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.228941    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.229175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.229029    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.229175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.229059    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjvzt\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.229175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.229092    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.229175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.229145    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.229468 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.229193    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.241394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.241345    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:08:31.331003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.330961    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.331310 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331289    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.331478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331458    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjvzt\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.331612 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331597    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.331752 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331736    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.331879 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331865    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.332043    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332189 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.332172    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332328 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.332312    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331938    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332602 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.331670    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.332602 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.332176    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.333382 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.333345    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.333795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.333768    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.336497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.336410    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.336665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.336639    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.423446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.423145    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjvzt\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.429865 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.426041    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:08:31.436003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.435924    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.463549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.463188    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:31.463738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.463575    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:08:31.464612 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.464060    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.470833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.470802    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.473800 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.473752    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:08:31.575172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575133    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575184    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.575338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575235    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575267    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575316    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575339    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dsbz\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575403    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575461    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575494    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575545    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv52h\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.575617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575579    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575631    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.575909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575860    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.575909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575891    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.576057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575964    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.576057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.575994    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.576057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.576021    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.576057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.576044    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.577166 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.577139    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:08:31.677475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677357    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677424    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677448    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv52h\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677469    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677502    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677533    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677551    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677595    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677612    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677630    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677644    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677688    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677707    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677742    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677762    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677792    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677809    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dsbz\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.677869 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.677842    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.678654 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.678630    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.679742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.679345    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.679742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.679664    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.679742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.679729    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.680005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.679982    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.680072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.679989    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.680558 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.680401    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.680558 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.680535    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.680737 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.680670    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.680809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.680785    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.681505 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.681478    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.686409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.682778    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.686409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.682909    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.686409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.683113    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.740043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.740006    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.740578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.740543    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.740812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.740786    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv52h\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.741409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.741362    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dsbz\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.881475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.881443    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:31.906806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.906596    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:31.980407 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:08:31.979835    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e9d472_eba4_4ea1_abb6_847c3c9bdd1c.slice/crio-d3b72385f81cdfa8e9a3aa841aca27e435d9464540f01c29b1bcd487e32b7d42 WatchSource:0}: Error finding container d3b72385f81cdfa8e9a3aa841aca27e435d9464540f01c29b1bcd487e32b7d42: Status 404 returned error can't find the container with id d3b72385f81cdfa8e9a3aa841aca27e435d9464540f01c29b1bcd487e32b7d42
Oct 30 22:08:31.990990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.988202    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:31.990990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.988291    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:31.990990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:31.988340    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.008480 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.008416    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:08:32.157870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.157830    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" event={"ID":"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c","Type":"ContainerStarted","Data":"d3b72385f81cdfa8e9a3aa841aca27e435d9464540f01c29b1bcd487e32b7d42"}
Oct 30 22:08:32.297695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.297662    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:08:32.304722 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:08:32.304690    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d15129_80fb_4970_8a5c_c3410f562bea.slice/crio-b98b8afea603586ab0ee3f6257efd39978c8534cfecdff8cc25e2c42b6e84cf6 WatchSource:0}: Error finding container b98b8afea603586ab0ee3f6257efd39978c8534cfecdff8cc25e2c42b6e84cf6: Status 404 returned error can't find the container with id b98b8afea603586ab0ee3f6257efd39978c8534cfecdff8cc25e2c42b6e84cf6
Oct 30 22:08:32.308973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.308928    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.309196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.309160    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.309394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.309354    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.566482 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.561805    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:08:32.566482 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:08:32.566267    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b34af5_e750_46a0_b679_24bfd704731d.slice/crio-dd2d2253a0e20bf80698b9b3aa44a2ea356df60c042f72b3776452c41ae60e4c WatchSource:0}: Error finding container dd2d2253a0e20bf80698b9b3aa44a2ea356df60c042f72b3776452c41ae60e4c: Status 404 returned error can't find the container with id dd2d2253a0e20bf80698b9b3aa44a2ea356df60c042f72b3776452c41ae60e4c
Oct 30 22:08:32.569164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.569120    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.569308 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.569224    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:32.569308 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:32.569270    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:08:33.165950 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.165916    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" event={"ID":"d2d15129-80fb-4970-8a5c-c3410f562bea","Type":"ContainerStarted","Data":"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"}
Oct 30 22:08:33.166498 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.165967    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" event={"ID":"d2d15129-80fb-4970-8a5c-c3410f562bea","Type":"ContainerStarted","Data":"b98b8afea603586ab0ee3f6257efd39978c8534cfecdff8cc25e2c42b6e84cf6"}
Oct 30 22:08:33.169064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.169035    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" event={"ID":"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c","Type":"ContainerStarted","Data":"d3f43049808db65787f050e8e01bfb2c5ee8cae6b23ff547c070a762fd0280fe"}
Oct 30 22:08:33.171308 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.171284    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" event={"ID":"16b34af5-e750-46a0-b679-24bfd704731d","Type":"ContainerStarted","Data":"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"}
Oct 30 22:08:33.171436 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.171328    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" event={"ID":"16b34af5-e750-46a0-b679-24bfd704731d","Type":"ContainerStarted","Data":"dd2d2253a0e20bf80698b9b3aa44a2ea356df60c042f72b3776452c41ae60e4c"}
Oct 30 22:08:33.322396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.316259    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podStartSLOduration=2.316236726 podStartE2EDuration="2.316236726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:33.313939266 +0000 UTC m=+1401.428647619" watchObservedRunningTime="2026-10-30 22:08:33.316236726 +0000 UTC m=+1401.430945081"
Oct 30 22:08:33.464910 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.464884    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:33.466440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.466414    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:33.466578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.466475    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:33.586395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.582427    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podStartSLOduration=2.582404474 podStartE2EDuration="2.582404474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:33.461553054 +0000 UTC m=+1401.576261408" watchObservedRunningTime="2026-10-30 22:08:33.582404474 +0000 UTC m=+1401.697112826"
Oct 30 22:08:33.886459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.882357    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:33.886459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.884104    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:33.886459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.884164    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:33.929399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.911454    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:33.929399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.911599    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:33.929399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:33.911646    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:34.464389 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.464300    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.464903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.464418    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:34.881830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.881733    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.881830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.881809    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:34.915477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.915438    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.915757 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:34.915727    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:35.465107 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.465064    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.465546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.465130    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:35.669360 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:08:35.669325    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:08:35.882129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.882037    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.882129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.882094    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:35.911407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.910565    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.911407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:35.910689    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:36.469427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.464847    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.469427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.466471    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:36.886453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.882661    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.886453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.882725    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:36.951401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.932591    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.951401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:36.932655    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:37.467860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.467820    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.468139 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.468110    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:37.882004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.881894    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.882451 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.881995    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:37.949402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.937881    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.949402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:37.937948    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:38.466258 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.466223    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.466567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.466536    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:08:38.882296 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.882221    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.882763 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.882287    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 30 22:08:38.909936 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.909440    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.909936 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:38.909517    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 22:08:39.986785 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:39.986752    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:39.988631 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:39.988607    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:39.990100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:39.990077    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:08:40.212112 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.212044    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podStartSLOduration=9.211987733 podStartE2EDuration="9.211987733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:33.587398818 +0000 UTC m=+1401.702107172" watchObservedRunningTime="2026-10-30 22:08:40.211987733 +0000 UTC m=+1408.326696097"
Oct 30 22:08:40.234548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.234519    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:40.235256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.235233    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:40.237336 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.237274    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:08:40.410704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.410671    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:40.411301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.411275    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:40.412941 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:40.412919    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:08:56.454464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:08:56.386269    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:02.696742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.696711    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:09:02.700795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.700777    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.761769 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.761738    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:09:02.847223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847183    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847275    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847436    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847493    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847541    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847659 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847640    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78pwq\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847694    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847801    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.847883 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.847864    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949384    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949439    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949516    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949564    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949658    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949690    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949712    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949763    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78pwq\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949792    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.949917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.949886    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.950056 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.950031    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.950218 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.950181    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.950522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.950429    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.950598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.950530    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.952036 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.952015    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:02.952302 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:02.952284    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:03.011551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.011516    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:03.011694 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.011615    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78pwq\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:03.014715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.014692    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:03.455855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.455826    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:09:03.457699 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:09:03.457672    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2916b9_83e4_4582_820d_5f321e6aa635.slice/crio-d4474884ec1bdc175a2c7c8338620fc40423cdd46d97bea8e3276c7fc6458936 WatchSource:0}: Error finding container d4474884ec1bdc175a2c7c8338620fc40423cdd46d97bea8e3276c7fc6458936: Status 404 returned error can't find the container with id d4474884ec1bdc175a2c7c8338620fc40423cdd46d97bea8e3276c7fc6458936
Oct 30 22:09:03.460005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.459971    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:03.460087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.460035    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:03.460087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.460079    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:03.527556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:03.527526    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" event={"ID":"3d2916b9-83e4-4582-820d-5f321e6aa635","Type":"ContainerStarted","Data":"d4474884ec1bdc175a2c7c8338620fc40423cdd46d97bea8e3276c7fc6458936"}
Oct 30 22:09:04.535380 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:04.535337    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" event={"ID":"3d2916b9-83e4-4582-820d-5f321e6aa635","Type":"ContainerStarted","Data":"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"}
Oct 30 22:09:04.725405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:04.725320    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podStartSLOduration=2.725303237 podStartE2EDuration="2.725303237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:04.721905478 +0000 UTC m=+1432.836613828" watchObservedRunningTime="2026-10-30 22:09:04.725303237 +0000 UTC m=+1432.840011588"
Oct 30 22:09:05.015799 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:05.015761    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:05.017496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:05.017467    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:05.017660 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:05.017534    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:05.614309 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:09:05.614201    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:09:06.015949 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:06.015922    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:06.016155 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:06.015968    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:07.015204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:07.015165    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:07.015661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:07.015220    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:08.015462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:08.015423    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:08.015924 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:08.015482    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:09.015854 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:09.015818    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:09.016307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:09.015881    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:10.015441 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:10.015405    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:09:10.015617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:10.015479    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:09:10.970547 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:10.970518    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:09:10.974615 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:10.974596    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.020659 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.020630    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:11.020946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.020926    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:11.021594 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.021576    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:09:11.080144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.080098    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:09:11.080788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.080757    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.080937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.080814    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.080937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.080856    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brpgl\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081051 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.080954    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.081210    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.081262    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081358 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.081343    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081457 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.081407    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.081457 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.081449    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183062 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183033    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183072    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183101    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brpgl\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183248 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183159    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183255    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183295    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183354    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183417    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183442    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183446    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183700    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183798    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183819    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.183928 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.183913    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.185699 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.185677    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.185824 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.185807    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.246790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.246705    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.247057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.246992    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brpgl\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.289944 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.289916    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:11.724930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.724892    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:09:11.726938 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:09:11.726909    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de64701_e392_4f8f_a26b_3e499e6b0746.slice/crio-3d0d8c5c37458f496e7cd0aab0f759baee0f713ab37f94a0a6b9c5d1ad09c245 WatchSource:0}: Error finding container 3d0d8c5c37458f496e7cd0aab0f759baee0f713ab37f94a0a6b9c5d1ad09c245: Status 404 returned error can't find the container with id 3d0d8c5c37458f496e7cd0aab0f759baee0f713ab37f94a0a6b9c5d1ad09c245
Oct 30 22:09:11.729686 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.729650    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:11.729783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.729729    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:11.729783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:11.729760    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:12.615396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:12.612296    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" event={"ID":"5de64701-e392-4f8f-a26b-3e499e6b0746","Type":"ContainerStarted","Data":"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"}
Oct 30 22:09:12.615396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:12.612384    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" event={"ID":"5de64701-e392-4f8f-a26b-3e499e6b0746","Type":"ContainerStarted","Data":"3d0d8c5c37458f496e7cd0aab0f759baee0f713ab37f94a0a6b9c5d1ad09c245"}
Oct 30 22:09:12.735541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:12.735484    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podStartSLOduration=2.735467103 podStartE2EDuration="2.735467103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:12.733956865 +0000 UTC m=+1440.848665217" watchObservedRunningTime="2026-10-30 22:09:12.735467103 +0000 UTC m=+1440.850175453"
Oct 30 22:09:13.303396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:13.291717    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:13.310712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:13.310682    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:13.310880 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:13.310740    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:14.295400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:14.292486    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:14.295400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:14.292566    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:15.300397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:15.299781    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:15.300397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:15.299847    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:16.302408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:16.301852    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:16.302408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:16.301946    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:17.307397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:17.297778    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:17.307397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:17.297879    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:18.290422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:18.290360    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:09:18.290649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:18.290445    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:09:19.294902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:19.294872    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:19.295315 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:19.295149    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:19.295946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:19.295926    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:09:26.314043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.313964    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:09:26.319408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.319386    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.399830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.399780    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.399830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.399830    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400131 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400017    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400131 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400072    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269kc\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400324    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400474    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400549    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400582    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.400727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.400665    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.428448 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.428412    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:09:26.501877 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.501845    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.501900    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269kc\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.501962    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502015    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502042    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502069    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502117    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502144    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502171    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502316    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502575    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502744    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.502897 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.502787    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.503023 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.503001    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.505132 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.505109    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.505492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.505468    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.563496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.563459    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.563636 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.563469    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-269kc\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-g2w2p\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:26.633412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:26.633328    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:27.071695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.071668    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:09:27.073478 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:09:27.073451    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7f84f6_4a82_4cf2_b195_6c53dbae0f70.slice/crio-551bf30e56573267d1df188e065e74487faee0a681622735cd1d522899bfc2d7 WatchSource:0}: Error finding container 551bf30e56573267d1df188e065e74487faee0a681622735cd1d522899bfc2d7: Status 404 returned error can't find the container with id 551bf30e56573267d1df188e065e74487faee0a681622735cd1d522899bfc2d7
Oct 30 22:09:27.075953 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.075915    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:27.076053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.075996    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:27.076053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.076037    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:27.711647 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.711609    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" event={"ID":"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70","Type":"ContainerStarted","Data":"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"}
Oct 30 22:09:27.712111 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.711665    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" event={"ID":"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70","Type":"ContainerStarted","Data":"551bf30e56573267d1df188e065e74487faee0a681622735cd1d522899bfc2d7"}
Oct 30 22:09:27.835447 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:27.835400    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podStartSLOduration=1.835363606 podStartE2EDuration="1.835363606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:27.833823278 +0000 UTC m=+1455.948531632" watchObservedRunningTime="2026-10-30 22:09:27.835363606 +0000 UTC m=+1455.950071957"
Oct 30 22:09:28.634188 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:28.634153    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:28.636005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:28.635977    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:28.636157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:28.636036    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:29.642141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:29.637772    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:29.642141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:29.637848    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:30.640401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:30.638779    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:30.640401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:30.638853    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:31.455500 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.455454    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:31.499482 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.499437    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:31.637397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.635783    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:31.637397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.635847    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:31.749400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.747542    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:31.906400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.902495    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:09:31.945535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.945481    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.123903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:31.997627    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:09:32.228930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.021475    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.228930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.062143    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.228930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.094906    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.228930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.123293    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.228930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.147546    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.256434 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.238215    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.362399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.356605    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.457679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.457574    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.458455 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.458424    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:09:32.736684 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.736539    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:32.736684 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.736598    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:32.752401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.748456    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.752401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.750100    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:09:32.806975 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.806927    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.903589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.903503    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.905763 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:32.905730    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:09:33.181462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.147663    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.218203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.181772    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.218203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.181816    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.218203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.208511    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.218203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.208986    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.218203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.216455    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.258414 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.243591    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.258767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.258732    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:09:33.259325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.259305    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:09:33.309419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.279438    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:09:33.311191 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.311166    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:09:33.348559 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.348525    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:09:33.348859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.348844    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:09:33.460456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.372729    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.604802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.481519    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.817014 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.816966    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.862147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.862113    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:33.862490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.862440    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:33.891596 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.519627    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.990988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:33.606298    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:09:34.016193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.016086    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.146461 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.121556    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:34.146461 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.121634    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.278063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.278016    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.457594 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.279646    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.458282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.329743    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.458778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.330007    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.459232 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.374902    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.459612 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.407553    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.716054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.716016    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.719480 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.719430    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.966493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.871549    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:34.966493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.871630    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:34.966493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.893059    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.966493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.895516    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p" podUID="b38079a8-a336-4e83-95ec-5cfa41517470" containerName="cert-manager-webhook" probeResult="failure" output="Get \"http://10.134.0.22:6080/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.966493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:34.950819    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.026421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.026356    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.364949 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:09:35.364860    5967 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.295s"
Oct 30 22:09:35.365199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.365186    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:09:35.365364 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.365354    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:09:35.400397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.380189    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:09:35.408159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.408119    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/health\": context deadline exceeded"
Oct 30 22:09:35.442105 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.442064    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.470118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.466643    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.470118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.466989    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:09:35.470118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.467450    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:09:35.678403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.677681    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:09:35.680256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.680217    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:35.680528 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.680498    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:35.690354 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.690329    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:09:35.717125 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.717083    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.745358 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.745326    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:09:35.762591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.762549    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-j2sds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:35.763000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.762960    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.766402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.763455    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:35.766402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.763497    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.807701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.807555    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.843430 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.834321    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:09:35.889013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:35.888981    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:09:36.054294 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:09:36.054262    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:09:36.096135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.096010    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:09:36.484732 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.458636    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.484732 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.467655    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.680398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.645754    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:36.680398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.645815    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:36.725442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.689829    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:09:36.760793 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.760708    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:09:36.822579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.813714    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:09:36.860396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.856494    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.938878 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:36.905279    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:09:37.062173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:37.061935    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:09:37.638757 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:37.638163    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:09:37.638757 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:37.638220    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 22:09:39.036181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:39.036150    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:39.036854 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:39.036832    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:39.037973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:39.037949    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:09:56.320442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.320402    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:09:56.325706 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.325681    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415410    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415604 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415493    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7dv\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415604 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415520    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415604 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415544    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415619    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415652    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415666    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415687    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.415834 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.415721    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.434945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.434902    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:09:56.517624 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.517591    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.517845 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.517754    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.517845 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.517817    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7dv\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.517965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.517852    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.517965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.517887    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.518063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.518010    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.518116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.518067    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.518116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.518094    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.518214 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.518131    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.519436 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.519358    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.519589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.519545    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.519722 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.519682    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.519989 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.519967    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.520270 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.520248    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.524672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.524648    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.524982 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.524950    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.580394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.580306    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.580915 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.580893    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7dv\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:56.642543 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:56.642503    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:57.076701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.076675    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:09:57.078820 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:09:57.078795    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7968283a_186f_4fac_8e47_25644285f4b8.slice/crio-f54fc690105dbf873969bbe48a389d7125f46c59fdfd1ad71bec2fde3021ee0c WatchSource:0}: Error finding container f54fc690105dbf873969bbe48a389d7125f46c59fdfd1ad71bec2fde3021ee0c: Status 404 returned error can't find the container with id f54fc690105dbf873969bbe48a389d7125f46c59fdfd1ad71bec2fde3021ee0c
Oct 30 22:09:57.081346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.081314    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:57.081473 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.081417    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:57.081473 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.081452    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:09:57.660803 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.660766    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" event={"ID":"7968283a-186f-4fac-8e47-25644285f4b8","Type":"ContainerStarted","Data":"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"}
Oct 30 22:09:57.661198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.660847    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" event={"ID":"7968283a-186f-4fac-8e47-25644285f4b8","Type":"ContainerStarted","Data":"f54fc690105dbf873969bbe48a389d7125f46c59fdfd1ad71bec2fde3021ee0c"}
Oct 30 22:09:57.783164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:57.783106    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podStartSLOduration=1.783092372 podStartE2EDuration="1.783092372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:57.780729227 +0000 UTC m=+1485.895437604" watchObservedRunningTime="2026-10-30 22:09:57.783092372 +0000 UTC m=+1485.897800723"
Oct 30 22:09:58.643398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:58.643333    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:09:58.645054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:58.645027    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:09:58.645186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:58.645076    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:09:59.643810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:59.643769    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:09:59.644226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:09:59.643838    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:10:00.643696 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:00.643655    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:10:00.643908 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:00.643730    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:10:01.643605 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:01.643568    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:10:01.643798 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:01.643625    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:10:02.509408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.509053    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:10:02.513068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.513047    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531013    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8qwh\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531076    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531172    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531207    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531331 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531235    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531340    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531478    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531666 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531651    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.531734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.531703    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.617492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.617456    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:10:02.633445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633001    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633095    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633185    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8qwh\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633450    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633502    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633539    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633573    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633613    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.633818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.633693    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.634199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.634169    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.634304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.634215    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.635057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.634928    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.635331 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.635082    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.637085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.635839    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.649165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.648715    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:10:02.649165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.648784    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:10:02.651865 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.651834    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.652039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.652018    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.712020 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.711991    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.714014 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.713987    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8qwh\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.827853 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.827769    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:02.930782 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.921533    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:10:02.936576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.934652    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:02.938616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.938137    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:10:02.953094 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.952677    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:02.970479 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:02.970310    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:10:03.040172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.040140    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:10:03.043304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043275    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043332    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043401    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjmv\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043428    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043555 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043450    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043555 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043479    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043555 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043498    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043555 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043514    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043555 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043536    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043566    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043611    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043632    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhfww\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043680    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043701    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043747    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043777    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.043862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043793    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.043862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.043812    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145056    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145105    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhfww\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145174    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145205    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145286    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145332    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145355    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145411    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145520    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145636    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.145835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145702    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145768    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjmv\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145796    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.145835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145816    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146019 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.145990    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146042    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146044    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146063    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146111    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146140    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146168    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146284    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146347    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146421    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146671    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.146844 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146823    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.146932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.146851    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.147097 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.147075    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.148754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.148726    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.149349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.149321    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.149567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.149549    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.150058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.150036    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.210971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.210941    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhfww\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.211146 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.210981    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.211591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.211191    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.211903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.211883    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjmv\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.260787 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.260761    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:03.270100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.270080    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:03.311245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.311208    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:10:03.316383 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:10:03.316319    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3820681d_2825_4eb8_96e4_f83eb9ac5658.slice/crio-edd92766190edd127bdc63cb06ee144dfced3859130179c588a7c8f0ae61c98d WatchSource:0}: Error finding container edd92766190edd127bdc63cb06ee144dfced3859130179c588a7c8f0ae61c98d: Status 404 returned error can't find the container with id edd92766190edd127bdc63cb06ee144dfced3859130179c588a7c8f0ae61c98d
Oct 30 22:10:03.319963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.319899    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.320194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.320135    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.320349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.320292    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.643642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.643603    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:10:03.644029 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.643677    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 22:10:03.694280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.694257    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:10:03.697193 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:10:03.697161    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c384f68_f9d4_4cbe_b93b_6994ecaaf208.slice/crio-6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5 WatchSource:0}: Error finding container 6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5: Status 404 returned error can't find the container with id 6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5
Oct 30 22:10:03.700009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.699974    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.700121 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.700048    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.700121 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.700081    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.725304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.725271    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" event={"ID":"5c384f68-f9d4-4cbe-b93b-6994ecaaf208","Type":"ContainerStarted","Data":"6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5"}
Oct 30 22:10:03.729234 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.729203    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" event={"ID":"3820681d-2825-4eb8-96e4-f83eb9ac5658","Type":"ContainerStarted","Data":"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"}
Oct 30 22:10:03.729347 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.729265    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" event={"ID":"3820681d-2825-4eb8-96e4-f83eb9ac5658","Type":"ContainerStarted","Data":"edd92766190edd127bdc63cb06ee144dfced3859130179c588a7c8f0ae61c98d"}
Oct 30 22:10:03.734970 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.732864    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:10:03.742807 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:10:03.742785    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c7b1fc_da95_4416_bdb2_a5a64596a1c9.slice/crio-c79ad4bc794a05bcffe66f701cb70309fabc9b358fc452569d82287da6805247 WatchSource:0}: Error finding container c79ad4bc794a05bcffe66f701cb70309fabc9b358fc452569d82287da6805247: Status 404 returned error can't find the container with id c79ad4bc794a05bcffe66f701cb70309fabc9b358fc452569d82287da6805247
Oct 30 22:10:03.746050 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.746018    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.746151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.746108    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.746215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.746150    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:03.828489 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:03.828457    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:04.759889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.759844    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" event={"ID":"44c7b1fc-da95-4416-bdb2-a5a64596a1c9","Type":"ContainerStarted","Data":"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"}
Oct 30 22:10:04.760981 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.760958    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" event={"ID":"44c7b1fc-da95-4416-bdb2-a5a64596a1c9","Type":"ContainerStarted","Data":"c79ad4bc794a05bcffe66f701cb70309fabc9b358fc452569d82287da6805247"}
Oct 30 22:10:04.762793 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.762771    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" event={"ID":"5c384f68-f9d4-4cbe-b93b-6994ecaaf208","Type":"ContainerStarted","Data":"2ad6001559d86563d111355722385f829007bf81bbb3998531c3bc717bf277b9"}
Oct 30 22:10:04.894395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.893481    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:04.894395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.893542    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:04.938911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:04.908964    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podStartSLOduration=2.9089383250000003 podStartE2EDuration="2.908938325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:03.860446905 +0000 UTC m=+1491.975155257" watchObservedRunningTime="2026-10-30 22:10:04.908938325 +0000 UTC m=+1493.023646680"
Oct 30 22:10:05.108460 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.092854    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:10:05.158459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.124578    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:10:05.177410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.159107    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:10:05.262399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.192972    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podStartSLOduration=3.192893418 podStartE2EDuration="3.192893418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:04.893981246 +0000 UTC m=+1493.008689599" watchObservedRunningTime="2026-10-30 22:10:05.192893418 +0000 UTC m=+1493.307601773"
Oct 30 22:10:05.262755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.262716    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:05.288398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.268490    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.288398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.268576    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:05.288398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.270387    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:05.288398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.286544    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.288398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.286611    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:05.289757 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.289690    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podStartSLOduration=3.289668069 podStartE2EDuration="3.289668069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:05.123311896 +0000 UTC m=+1493.238020245" watchObservedRunningTime="2026-10-30 22:10:05.289668069 +0000 UTC m=+1493.404376422"
Oct 30 22:10:05.799469 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:10:05.795776    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:10:05.861406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.848526    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.861406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:05.848591    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:06.262456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.262421    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.262672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.262549    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:06.271769 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.271741    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.271854 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.271800    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:06.829410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.828842    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.829410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:06.828912    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:07.274399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.272801    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.274399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.272866    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:07.274399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.273605    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.274399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.273649    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:07.835692 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.835617    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.836493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:07.836447    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:08.282401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.264950    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.282401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.265075    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:08.282401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.276247    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.282401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.276331    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:08.454203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.438325    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.454203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.450975    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Oct 30 22:10:08.506711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.506668    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.524516 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.524462    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.524829 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.524802    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.525386 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.524987    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.525735 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.525013    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:10:08.672454 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.671745    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.731513 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.731468    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.768051 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.768009    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.833342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.831417    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.833342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.831481    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:08.889069 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.888688    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.982596 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:08.982482    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.074480 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.071172    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.094437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.094388    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.270887 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.270792    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.271145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.271115    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:09.271332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.271315    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.271494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.271474    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:09.459914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.459860    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.460637 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.460614    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:09.510269 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.508478    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.510269 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.508880    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:10:09.527624 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.527523    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.529391 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.527869    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.529391 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.528350    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:10:09.535148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.535123    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:10:09.792202 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.527461    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.839405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.825575    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:09.943346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.925185    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.943346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:09.925264    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:10.033656 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.027271    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.033944 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.033895    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.034789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.034767    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:10.041543 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.041517    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:10:10.099451 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.096242    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.140091 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.113837    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.403482 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.386270    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.406993 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.406941    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.432453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.417181    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.432453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.417242    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:10.502549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.472776    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.502549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.472849    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:10.502549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.486002    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.536174 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.536112    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.758446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.740921    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.758446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.743969    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.820414 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.818400    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.856871 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.856834    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.857216 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:10.857176    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:11.045906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.045805    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:10:11.046574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.046553    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:11.048597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.048573    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:10:11.048818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.048788    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:10:11.049032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.049010    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:11.190397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.151389    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.190397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.151735    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.190851 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.190810    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:11.194395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.191018    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.217427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.206985    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.273403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.268617    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.273403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.268679    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:11.275757 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.275722    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.275984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.275955    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:11.408581 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.408478    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.461535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.461487    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.488540 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.488492    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.547591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.547530    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.801450 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.786547    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 22:10:11.801450 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.786952    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:11.852426 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.831700    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.852426 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:11.831763    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:12.325591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.325548    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.348407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.341003    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.400402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.381267    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.400402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.381319    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:12.400402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.381944    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.400402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.382141    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.441409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.436105    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.486418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.464544    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.516597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.516480    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.544600 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.544555    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.603569 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.603465    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.645408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.617047    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.645408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.617107    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:12.789597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.789549    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.790704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.790668    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.801165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.801127    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/health\": context deadline exceeded"
Oct 30 22:10:12.928247 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.923578    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.940734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:12.936094    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:13.143394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.136483    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.264382 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.264323    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.264668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.264622    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:13.272036 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.271992    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.295346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.295140    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:13.318530 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.318475    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.327845 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.327802    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.358146 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.357725    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.399862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.399813    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.495492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.495449    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.525463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.524912    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.561526 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.561485    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.615569 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.615502    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.616688 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.616654    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.846452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.842796    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.850397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.846702    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:13.975888 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.975846    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.976594 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:13.976564    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:14.139558 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.139459    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.233408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.222329    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:14.265405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.261838    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.265405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.261914    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:14.278390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.278335    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.279053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.279022    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:14.340397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.340303    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.365428 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.365338    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.407491 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.402578    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.528540 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.528488    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.529155 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.529124    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Oct 30 22:10:14.567402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.562328    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.643397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.616485    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.644763 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.623457    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.829244 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.829207    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.829579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.829546    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:14.981711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.981671    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.983631 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:14.983603    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:15.006154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.006127    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:10:15.043771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.043743    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:10:15.162186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.161359    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.262781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.262745    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:15.263114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.263054    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:15.272821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.272715    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:15.272821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.272767    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:15.343251 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.342466    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:10:15.383490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.383443    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.407203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.407158    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.407902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.407864    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:10:15.533042 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.532538    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Oct 30 22:10:15.563198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.563161    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.579601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.576762    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.593403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.576866    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:10:15.677081 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.677036    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.708397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.685298    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:10:15.744029 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.743974    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:15.755882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.755838    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:10:15.850455 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.838477    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:10:15.850455 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.838548    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:10:15.864006 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.863975    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:15.876002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.873908    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:10:15.876002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.875418    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:10:15.876983 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.876340    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:10:15.940785 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.940756    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:15.951451 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.950539    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:10:15.980309 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:15.979487    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:16.261677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:16.261557    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.261677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:16.261614    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 22:10:16.271682 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:16.271551    5967 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.271682 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:16.271614    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:10:17.124771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.124740    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:17.130979 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.130903    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:17.141160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.140513    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:10:17.698505 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.698472    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:17.698935 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.698905    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:17.699893 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.699871    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:10:17.803411 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.803359    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:17.804064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.804039    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:17.805170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:17.805149    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:10:35.593281 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:10:35.593243    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:10:41.218118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.218081    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:10:41.222420 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.222363    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.278497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.278467    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mjfxd\""
Oct 30 22:10:41.294845 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.294807    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 22:10:41.295015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.294865    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 22:10:41.295015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.294906    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 22:10:41.332063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.332027    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:10:41.384853 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.384823    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.384863    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj888\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.384973    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.385016    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.385045    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385228 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.385207    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.385262 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.385243    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.486997 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.486901    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.486997 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.486950    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj888\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487254 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487043    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487254 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487151    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487254 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487191    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487353    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487410    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.487910 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.487881    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.489837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.489815    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.489973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.489850    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.490045 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.490020    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.490322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.490300    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.549002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.548964    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj888\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.549198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.549178    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-sxwsm\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:41.834631 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:41.834564    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:42.289731 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:42.289693    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:10:42.291337 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:10:42.291310    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f1508f_94e7_493e_ad29_22124b549f23.slice/crio-01b017286fe491fc01ae31a247def52a73503f2d5f5ada8c1b900fdccb55cd77 WatchSource:0}: Error finding container 01b017286fe491fc01ae31a247def52a73503f2d5f5ada8c1b900fdccb55cd77: Status 404 returned error can't find the container with id 01b017286fe491fc01ae31a247def52a73503f2d5f5ada8c1b900fdccb55cd77
Oct 30 22:10:42.293847 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:42.293830    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:10:43.193641 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:43.193608    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" event={"ID":"d2f1508f-94e7-493e-ad29-22124b549f23","Type":"ContainerStarted","Data":"01b017286fe491fc01ae31a247def52a73503f2d5f5ada8c1b900fdccb55cd77"}
Oct 30 22:10:46.214872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:46.214830    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:10:46.439090 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:46.439026    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.179024 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.178950    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.242751 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.242704    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": context deadline exceeded"
Oct 30 22:10:47.254404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.244094    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:10:47.267538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.267495    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/health\": context deadline exceeded"
Oct 30 22:10:47.332530 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.332479    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:10:47.502580 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.502527    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.571397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.546043    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.598399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.573270    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.713410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.710303    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/health\": context deadline exceeded"
Oct 30 22:10:47.783448 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.781220    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.801397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.798691    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.830422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.825915    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.936928 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:47.936868    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.193469 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.187796    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.269362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.269327    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:48.281727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.281682    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.282710 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.272040    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.305930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.298166    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.363071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.363030    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.450134 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.450021    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:10:48.451753 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.451719    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.536400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.507537    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.536400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.511091    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:48.536400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.511151    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:10:48.536400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.511189    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:48.580445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.580098    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Oct 30 22:10:48.580445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.580433    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:10:48.691541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.691497    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.719148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.719097    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.720832 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.720812    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:10:48.804634 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.804592    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.806523 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.806496    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:48.806767 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.806751    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:10:48.998467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.968951    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": context deadline exceeded"
Oct 30 22:10:49.002564 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.997224    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:49.002840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.002823    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:49.010230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.997677    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:10:49.011562 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:48.997720    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.011776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.011759    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:49.286871 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.286759    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.424829 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.388602    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:10:49.452653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.452517    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.453504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.453483    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:10:49.593461 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.592512    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.628697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.628166    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:49.669406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.658483    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-krl2p" podUID="b38079a8-a336-4e83-95ec-5cfa41517470" containerName="cert-manager-webhook" probeResult="failure" output="Get \"http://10.134.0.22:6080/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.721401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.719589    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.830407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.822598    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:49.856456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:49.846702    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.049446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.010689    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.311529 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.311462    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.359179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.359136    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:50.359500 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.359452    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.389578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.388778    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.418410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.397675    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:10:50.420524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.420490    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:10:50.604962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.604860    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.634987 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.634613    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.680404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.669486    5967 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:50.680404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.669558    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.766402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.755509    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.787406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.786448    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.872593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:50.866481    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.133895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.109575    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.133895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.110171    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.249462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.244323    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:51.249462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.244422    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.389580 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.357316    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.731070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.731034    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" probeResult="failure" output="Get \"https://10.134.0.45:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.732399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.732364    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:51.759284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.759247    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.918396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.816506    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.918396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.845541    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.918396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.904635    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.918396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.905665    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:51.918396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.869062    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.937610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.937585    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:10:51.977258 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:51.977229    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:10:52.109876 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.109797    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.111923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.111872    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:52.155399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.155341    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:52.156824 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.156569    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:10:52.158551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.158387    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:10:52.162487 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.162467    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:10:52.164811 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.164712    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:10:52.166471 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.166453    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:10:52.167614 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:52.167591    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:10:53.757202 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:53.757170    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:53.757538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:53.757234    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:10:54.004608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:54.004524    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" event={"ID":"d2f1508f-94e7-493e-ad29-22124b549f23","Type":"ContainerStarted","Data":"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"}
Oct 30 22:10:54.004768 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:54.004728    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:10:54.006432 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:54.006404    5967 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sxwsm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:10:54.006565 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:54.006451    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:10:54.128675 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:54.128629    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podStartSLOduration=1.666800963 podStartE2EDuration="13.128615385s" totalImagesPullingTime="11.461814422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:54.125318646 +0000 UTC m=+1542.240027010" watchObservedRunningTime="2026-10-30 22:10:54.128615385 +0000 UTC m=+1542.243323736"
Oct 30 22:10:55.011994 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:55.011962    5967 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sxwsm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:10:55.012414 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:55.012014    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:10:58.012402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:58.012218    5967 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sxwsm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:10:58.012868 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:10:58.012431    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:11:01.013036 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:01.013000    5967 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sxwsm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:11:01.013442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:01.013070    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:11:04.012244 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:04.012208    5967 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-sxwsm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:11:04.012748 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:04.012302    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:11:05.593547 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:11:05.593512    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:11:07.012080 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:07.012051    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:11:25.796398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:25.793276    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:11:25.796398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:25.793341    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:25.912392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:11:25.911531    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:35.593148 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:11:35.593100    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:12:05.632100 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:12:05.632065    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:12:34.042749 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.042720    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:12:34.046720 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.046701    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.092789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.092759    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:12:34.096590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.096575    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.136400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136353    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.136639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136609    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzt6k\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.136768 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136716    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.136836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136766    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.136836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136817    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.136942 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136849    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.136942 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136887    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.136942 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136924    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6mq\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.137086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136950    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.137086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.136991    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.137341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137317    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.137419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137358    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.137498 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137480    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.137552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137536    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.137647 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137628    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.137859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137837    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.137948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137925    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.138012 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.137993    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.142911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.142875    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:12:34.213474 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.213343    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:12:34.239087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239050    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239116    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239145    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzt6k\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239192    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239224    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239279 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239273    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239300    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239334    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239388    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6mq\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239414    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239450    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239572    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239626    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239658    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239707    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239740    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.239833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239761    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.240123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239854    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.240123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.239950    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.240249 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240224    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.241032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240247    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.241192 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240541    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.241318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240567    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.241471 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240712    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.241573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240833    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.241670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240953    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.241755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.240960    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.241839 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.241248    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.243717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.242774    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.243717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.243650    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.243873 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.243754    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.243967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.243949    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.306116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.306043    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.306235 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.306152    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6mq\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\") pod \"maas-default-gateway-openshift-default-6cc458d887-gfbt5\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.309107 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.309075    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.311083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.311062    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzt6k\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\") pod \"maas-default-gateway-openshift-default-6cc458d887-nntxm\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.361311 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.361286    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:34.409519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.409356    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:34.794080 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.794045    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:12:34.831837 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:12:34.831801    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ec1f86_96ca_4ac6_adb6_e3c6d04889bd.slice/crio-2601ab3ac1183d8d1024ca62ebddf70173b072390974c27034b3dbc5862785be WatchSource:0}: Error finding container 2601ab3ac1183d8d1024ca62ebddf70173b072390974c27034b3dbc5862785be: Status 404 returned error can't find the container with id 2601ab3ac1183d8d1024ca62ebddf70173b072390974c27034b3dbc5862785be
Oct 30 22:12:34.840889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.835608    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.840889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.835893    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.840889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.836273    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.852808 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.852777    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:12:34.858590 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:12:34.858546    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417aa34f_52c5_4319_82aa_17abe7820334.slice/crio-069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f WatchSource:0}: Error finding container 069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f: Status 404 returned error can't find the container with id 069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f
Oct 30 22:12:34.862064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.862017    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.862154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.862120    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.862189 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.862170    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:12:34.917926 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.917892    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" event={"ID":"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd","Type":"ContainerStarted","Data":"2601ab3ac1183d8d1024ca62ebddf70173b072390974c27034b3dbc5862785be"}
Oct 30 22:12:34.920100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:34.920074    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" event={"ID":"417aa34f-52c5-4319-82aa-17abe7820334","Type":"ContainerStarted","Data":"069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f"}
Oct 30 22:12:35.636141 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:12:35.636099    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:12:35.943212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:35.943116    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" event={"ID":"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd","Type":"ContainerStarted","Data":"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"}
Oct 30 22:12:35.945102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:35.945074    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" event={"ID":"417aa34f-52c5-4319-82aa-17abe7820334","Type":"ContainerStarted","Data":"bebd44bb8ceac861cc8d406519f9af63fa619a266c61f71e0ad98b21c1c05036"}
Oct 30 22:12:36.186415 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.183389    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podStartSLOduration=3.183348131 podStartE2EDuration="3.183348131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:36.130878887 +0000 UTC m=+1644.245587239" watchObservedRunningTime="2026-10-30 22:12:36.183348131 +0000 UTC m=+1644.298056483"
Oct 30 22:12:36.274129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.274080    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podStartSLOduration=2.274067122 podStartE2EDuration="2.274067122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:36.273049004 +0000 UTC m=+1644.387757356" watchObservedRunningTime="2026-10-30 22:12:36.274067122 +0000 UTC m=+1644.388775473"
Oct 30 22:12:36.361550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.361516    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:36.362635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.362614    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:36.362691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.362662    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:36.428986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.421186    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:36.428986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.422142    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:36.428986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:36.422195    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:37.362242 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:37.362199    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:37.362755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:37.362270    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:37.449245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:37.438261    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:37.449245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:37.438328    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:38.362090 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:38.362048    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:38.362307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:38.362121    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:38.413742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:38.413704    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:38.413986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:38.413959    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:39.362557 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:39.362526    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:39.363052 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:39.362573    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:39.412397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:39.411552    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:39.412397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:39.411610    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:40.362442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:40.362408    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:40.362624 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:40.362474    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:40.411812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:40.411773    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:40.412106 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:40.412072    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:41.362462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:41.362425    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:41.362674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:41.362487    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:41.410081 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:41.410034    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:41.410263 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:41.410092    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:42.370186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:42.370138    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:12:42.370663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:42.370224    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:12:42.409825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:42.409790    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:12:42.409965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:42.409854    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:12:43.495412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.495352    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:43.495949 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.495928    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:43.496750 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.496730    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:12:43.577303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.577268    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:43.577770 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.577748    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:12:43.578578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:12:43.578562    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:13:05.595466 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:13:05.595425    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:13:07.970388 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:07.970337    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:13:07.974496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:07.974472    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.100701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.100660    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.100903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.100829    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101020 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101003    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101027    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101250    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101359 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101325    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrl57\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101392    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101466    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.101587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.101492    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.141134 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.141105    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aa8c82d5-openshift-default-dockercfg-r2zpw\""
Oct 30 22:13:08.179040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.179011    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:13:08.202634 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.202592    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.202810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.202668    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.202810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.202772    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.202810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.202801    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.202952    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203000    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrl57\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203017    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203041    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203121    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203158    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203191    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203308    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203326    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.203994 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.203967    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.205801 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.205775    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.205916 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.205841    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.263933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.263878    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.264161 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.264141    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrl57\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.292663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.292638    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:08.728817 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:13:08.728784    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d37e8c4_5137_4c2c_8c4a_1651903805a9.slice/crio-6e5e131221803e5c1cc1eaa7311f874120c1b7772b8d24fbd4d3c8101171b808 WatchSource:0}: Error finding container 6e5e131221803e5c1cc1eaa7311f874120c1b7772b8d24fbd4d3c8101171b808: Status 404 returned error can't find the container with id 6e5e131221803e5c1cc1eaa7311f874120c1b7772b8d24fbd4d3c8101171b808
Oct 30 22:13:08.729170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.729144    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:13:08.731654 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.731621    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:08.731745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.731689    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:08.731745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:08.731720    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:09.190759 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.190664    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" event={"ID":"9d37e8c4-5137-4c2c-8c4a-1651903805a9","Type":"ContainerStarted","Data":"bff4d12ab0c64a23e1d59a67f30f87816b3c3a9bb6ab9811dd361039eb240623"}
Oct 30 22:13:09.190759 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.190733    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" event={"ID":"9d37e8c4-5137-4c2c-8c4a-1651903805a9","Type":"ContainerStarted","Data":"6e5e131221803e5c1cc1eaa7311f874120c1b7772b8d24fbd4d3c8101171b808"}
Oct 30 22:13:09.293591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.293557    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:09.294953 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.294927    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:09.295094 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.294982    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:09.316355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:09.316301    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podStartSLOduration=2.316287334 podStartE2EDuration="2.316287334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:09.31277038 +0000 UTC m=+1677.427478754" watchObservedRunningTime="2026-10-30 22:13:09.316287334 +0000 UTC m=+1677.430995685"
Oct 30 22:13:10.304395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:10.302775    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:10.304395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:10.302837    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:11.307846 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:11.307802    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:11.308300 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:11.307863    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:12.309094 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:12.309057    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:12.309665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:12.309118    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:13.302396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:13.300968    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:13.302396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:13.301564    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:14.307398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:14.301465    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:14.307398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:14.301549    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:15.293271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:15.293228    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:13:15.293491 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:15.293294    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:13:16.297475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:16.297445    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:16.297874 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:16.297710    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:16.298334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:16.298317    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:13:35.593983 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:13:35.593949    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:13:38.236253 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.236223    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:13:38.240583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.240562    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.283535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.283508    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:13:38.288363 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.288336    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.358578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.358547    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:13:38.362275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.362254    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:13:38.380074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380044    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.380221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380162    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380216    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380343 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380320    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.380412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380356    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.380463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380424    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380554    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.380618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380596    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29lsq\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380705 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380676    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380797 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380779    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9t2\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.380870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380855    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.380970 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.380955    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.381031 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381008    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.381086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381041    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.381086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381078    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.381196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381177    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.381342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381323    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.381410 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.381354    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.482838 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.482803    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.482838 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.482840    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.482896    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.482931    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.482974    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483030    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483053    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483074    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483133    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483163    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29lsq\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483192    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483254    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9t2\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483315    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483412    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483442    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483520    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483521    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483587    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483632    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483678    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.483870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483735    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.483870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483819    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.484113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.483872    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.484113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.484036    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.484226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.484203    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.484363 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.484334    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.484528 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.484446    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.484528 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.484480    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.485780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.485756    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.486098 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.486075    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.486422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.486325    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.486422 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.486344    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.545676 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.545640    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.545868 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.545845    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.545940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.545920    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9t2\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.546243 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.546220    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29lsq\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.554814 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.554788    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:38.601745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.601709    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:38.992800 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:38.992766    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:13:39.002331 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.002296    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.002434 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.002406    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.002476 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.002443    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.051306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.051278    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:13:39.058809 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:13:39.058783    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1221d38b_9f05_4322_a00a_e5ee74cde4f8.slice/crio-e78cb1b57a437c79ff23cbf008e6b92fb86549e3b6e777de5d4b6ceef34ce53a WatchSource:0}: Error finding container e78cb1b57a437c79ff23cbf008e6b92fb86549e3b6e777de5d4b6ceef34ce53a: Status 404 returned error can't find the container with id e78cb1b57a437c79ff23cbf008e6b92fb86549e3b6e777de5d4b6ceef34ce53a
Oct 30 22:13:39.063482 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.063446    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.063592 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.063528    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.063592 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.063574    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:13:39.477115 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.477075    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" event={"ID":"dc66a484-bf62-479d-bb11-543ad0798f0b","Type":"ContainerStarted","Data":"d348b815d826f72752c5687428002563a3be7d0a5da9fa3060ba174867a83600"}
Oct 30 22:13:39.477751 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.477181    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" event={"ID":"dc66a484-bf62-479d-bb11-543ad0798f0b","Type":"ContainerStarted","Data":"c85a24988f3d1f5fd3fd1cba68614fc5a4594f6dde90849bf24da718e760296d"}
Oct 30 22:13:39.478941 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.478911    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" event={"ID":"1221d38b-9f05-4322-a00a-e5ee74cde4f8","Type":"ContainerStarted","Data":"931ab6da84b335df7c7b7954aac2f96185d56becfae0c1154c1d6f87826456bc"}
Oct 30 22:13:39.479088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.478962    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" event={"ID":"1221d38b-9f05-4322-a00a-e5ee74cde4f8","Type":"ContainerStarted","Data":"e78cb1b57a437c79ff23cbf008e6b92fb86549e3b6e777de5d4b6ceef34ce53a"}
Oct 30 22:13:39.555551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.555517    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:39.600144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.600091    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podStartSLOduration=1.600077224 podStartE2EDuration="1.600077224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:39.596801297 +0000 UTC m=+1707.711509648" watchObservedRunningTime="2026-10-30 22:13:39.600077224 +0000 UTC m=+1707.714785574"
Oct 30 22:13:39.602296 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.602278    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:39.719529 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:39.719468    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podStartSLOduration=1.719447589 podStartE2EDuration="1.719447589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:39.717764897 +0000 UTC m=+1707.832473252" watchObservedRunningTime="2026-10-30 22:13:39.719447589 +0000 UTC m=+1707.834155941"
Oct 30 22:13:40.557300 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:40.557269    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:40.557721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:40.557338    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:40.635395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:40.634620    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:40.635395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:40.634697    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:41.572397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:41.559570    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:41.572397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:41.559701    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:41.607398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:41.604855    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:41.607398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:41.604939    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:42.562395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:42.561879    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:42.562395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:42.561964    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:42.608398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:42.608173    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:42.608398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:42.608247    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:43.555397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:43.555344    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:43.555598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:43.555456    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:43.613729 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:43.613693    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:43.651985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:43.651944    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:44.556516 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:44.555387    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:44.556516 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:44.555492    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:44.604829 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:44.604790    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:44.605128 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:44.605103    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:45.555955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:45.555921    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:13:45.556343 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:45.555970    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:13:45.616765 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:45.616730    5967 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:13:45.617047 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:45.617019    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:13:46.560083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.559752    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:46.562013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.561989    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:46.566302 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.566273    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:13:46.607673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.607645    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:46.607982 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.607963    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:46.608902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:46.608879    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:13:52.359015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:52.358509    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-f89xr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:13:52.359015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:13:52.358590    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-f89xr" podUID="cde9df19-6dd8-470c-ac0e-e53397101e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:05.593854 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:14:05.593816    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:14:20.274151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:20.274115    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:14:20.274835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:20.274343    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" containerID="cri-o://0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417" gracePeriod=30
Oct 30 22:14:20.322085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:20.322053    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:14:20.322283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:20.322256    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy" containerID="cri-o://06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023" gracePeriod=30
Oct 30 22:14:22.874210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.874177    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:14:22.874877 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.874844    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy" containerID="cri-o://bff4d12ab0c64a23e1d59a67f30f87816b3c3a9bb6ab9811dd361039eb240623" gracePeriod=30
Oct 30 22:14:22.904853 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.904825    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:14:22.905053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.905031    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy" containerID="cri-o://931ab6da84b335df7c7b7954aac2f96185d56becfae0c1154c1d6f87826456bc" gracePeriod=30
Oct 30 22:14:22.918664 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.918637    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:14:22.918855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:22.918823    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy" containerID="cri-o://d348b815d826f72752c5687428002563a3be7d0a5da9fa3060ba174867a83600" gracePeriod=30
Oct 30 22:14:25.026416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.025791    5967 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:14:25.026416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.025863    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:14:25.699424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.683489    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:14:25.764807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.764772    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.875737    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.875862    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.875896    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.875966    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876039    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876079    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876085    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876158    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876204    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876281    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876322    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876447    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876483    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876510    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876574    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876588    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876634    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876679    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876712    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876749    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\") pod \"3d2916b9-83e4-4582-820d-5f321e6aa635\" (UID: \"3d2916b9-83e4-4582-820d-5f321e6aa635\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876860    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\") pod \"54096256-ca0a-49be-919a-816ba85da6b1\" (UID: \"54096256-ca0a-49be-919a-816ba85da6b1\") "
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.876912    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.877045    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.877133    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.877353    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.877781    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.877430    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878138    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878161    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d2916b9-83e4-4582-820d-5f321e6aa635-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878179    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878194    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878208    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878221    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878235    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54096256-ca0a-49be-919a-816ba85da6b1-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.881392 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.878741    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.883415 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.882532    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.883836    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.883850    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.884030    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.884136    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "kube-api-access-78pwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.884277    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy" pod "3d2916b9-83e4-4582-820d-5f321e6aa635" (UID: "3d2916b9-83e4-4582-820d-5f321e6aa635"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.886489    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:25.887538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.887417    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd" pod "54096256-ca0a-49be-919a-816ba85da6b1" (UID: "54096256-ca0a-49be-919a-816ba85da6b1"). InnerVolumeSpecName "kube-api-access-x9zfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:25.985985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.985946    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.985985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.985987    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78pwq\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-kube-api-access-78pwq\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.985985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986004    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986016    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54096256-ca0a-49be-919a-816ba85da6b1-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986034    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986048    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986062    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986076    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986090    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9zfd\" (UniqueName: \"kubernetes.io/projected/54096256-ca0a-49be-919a-816ba85da6b1-kube-api-access-x9zfd\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986104    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d2916b9-83e4-4582-820d-5f321e6aa635-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:25.986306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:25.986118    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54096256-ca0a-49be-919a-816ba85da6b1-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:26.023472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.023343    5967 generic.go:356] "Generic (PLEG): container finished" podID="54096256-ca0a-49be-919a-816ba85da6b1" containerID="0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417" exitCode=0
Oct 30 22:14:26.023472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.023442    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"
Oct 30 22:14:26.025076 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.025047    5967 generic.go:356] "Generic (PLEG): container finished" podID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerID="06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023" exitCode=0
Oct 30 22:14:26.025225 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.025121    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"
Oct 30 22:14:26.028450 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.028419    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" event={"ID":"54096256-ca0a-49be-919a-816ba85da6b1","Type":"ContainerDied","Data":"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"}
Oct 30 22:14:26.028897 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.028476    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc" event={"ID":"54096256-ca0a-49be-919a-816ba85da6b1","Type":"ContainerDied","Data":"68b769999f7e23adf4bdf457215ce29d9e678e3a63eb68506c527615ceaa6d08"}
Oct 30 22:14:26.028897 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.028499    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" event={"ID":"3d2916b9-83e4-4582-820d-5f321e6aa635","Type":"ContainerDied","Data":"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"}
Oct 30 22:14:26.028897 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.028525    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp" event={"ID":"3d2916b9-83e4-4582-820d-5f321e6aa635","Type":"ContainerDied","Data":"d4474884ec1bdc175a2c7c8338620fc40423cdd46d97bea8e3276c7fc6458936"}
Oct 30 22:14:26.028897 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.028553    5967 scope.go:122] "RemoveContainer" containerID="0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"
Oct 30 22:14:26.060284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.060263    5967 scope.go:122] "RemoveContainer" containerID="0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"
Oct 30 22:14:26.060723 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:14:26.060701    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417\": container with ID starting with 0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417 not found: ID does not exist" containerID="0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"
Oct 30 22:14:26.060821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.060732    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417"} err="failed to get container status \"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417\": rpc error: code = NotFound desc = could not find container \"0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417\": container with ID starting with 0bc71d0ce9b713f895110342af8d6b8aa55a90fe549507cb3fa24d6e435e3417 not found: ID does not exist"
Oct 30 22:14:26.060821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.060759    5967 scope.go:122] "RemoveContainer" containerID="06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"
Oct 30 22:14:26.077534 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.077516    5967 scope.go:122] "RemoveContainer" containerID="06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"
Oct 30 22:14:26.077934 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:14:26.077911    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023\": container with ID starting with 06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023 not found: ID does not exist" containerID="06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"
Oct 30 22:14:26.078026 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.077947    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023"} err="failed to get container status \"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023\": rpc error: code = NotFound desc = could not find container \"06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023\": container with ID starting with 06f9a3dd3b6492c9b49046d91696755f5d47681976e727afb71dbc8781d55023 not found: ID does not exist"
Oct 30 22:14:26.192040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.192010    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:14:26.198414 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.198363    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-bq9gp"]
Oct 30 22:14:26.308999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.308900    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:14:26.315417 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:26.315364    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-mk7jc"]
Oct 30 22:14:28.021340 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.021309    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" path="/var/lib/kubelet/pods/3d2916b9-83e4-4582-820d-5f321e6aa635/volumes"
Oct 30 22:14:28.021883 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.021857    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54096256-ca0a-49be-919a-816ba85da6b1" path="/var/lib/kubelet/pods/54096256-ca0a-49be-919a-816ba85da6b1/volumes"
Oct 30 22:14:28.056944 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.056916    5967 generic.go:356] "Generic (PLEG): container finished" podID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerID="931ab6da84b335df7c7b7954aac2f96185d56becfae0c1154c1d6f87826456bc" exitCode=0
Oct 30 22:14:28.057074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.057065    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" event={"ID":"1221d38b-9f05-4322-a00a-e5ee74cde4f8","Type":"ContainerDied","Data":"931ab6da84b335df7c7b7954aac2f96185d56becfae0c1154c1d6f87826456bc"}
Oct 30 22:14:28.059898 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.059003    5967 generic.go:356] "Generic (PLEG): container finished" podID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerID="bff4d12ab0c64a23e1d59a67f30f87816b3c3a9bb6ab9811dd361039eb240623" exitCode=0
Oct 30 22:14:28.059898 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.059138    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" event={"ID":"9d37e8c4-5137-4c2c-8c4a-1651903805a9","Type":"ContainerDied","Data":"bff4d12ab0c64a23e1d59a67f30f87816b3c3a9bb6ab9811dd361039eb240623"}
Oct 30 22:14:28.062522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.062087    5967 generic.go:356] "Generic (PLEG): container finished" podID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerID="d348b815d826f72752c5687428002563a3be7d0a5da9fa3060ba174867a83600" exitCode=0
Oct 30 22:14:28.062522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.062115    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" event={"ID":"dc66a484-bf62-479d-bb11-543ad0798f0b","Type":"ContainerDied","Data":"d348b815d826f72752c5687428002563a3be7d0a5da9fa3060ba174867a83600"}
Oct 30 22:14:28.317769 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.317700    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:14:28.338474 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.336882    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:14:28.409928 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.409900    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:14:28.438551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438523    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.438697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438562    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.438697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438583    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.438697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438609    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.438697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438641    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.438697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438679    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438718    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438747    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438792    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438833    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438825    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438873    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438905    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.438948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438933    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.438831    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439023    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439031    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439071    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439105    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439148    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439204    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439218    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439233    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.439384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439332    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439423    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439579    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439626    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439669    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439760    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\") pod \"dc66a484-bf62-479d-bb11-543ad0798f0b\" (UID: \"dc66a484-bf62-479d-bb11-543ad0798f0b\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439795    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439802    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.439890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439867    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\") pod \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\" (UID: \"9d37e8c4-5137-4c2c-8c4a-1651903805a9\") "
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.439961    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\") pod \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\" (UID: \"1221d38b-9f05-4322-a00a-e5ee74cde4f8\") "
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440008    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440022    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440163    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440331    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.440492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440398    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:28.440786 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440593    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.440786 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440614    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.440884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.440808    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.441046 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441024    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441054    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441068    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc66a484-bf62-479d-bb11-543ad0798f0b-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441083    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441096    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441111    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441125    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441141    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441155    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441169    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441182    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441197    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441211    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441224    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.441574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.441274    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.442294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.442269    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "kube-api-access-kq9t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.443237 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.443215    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:28.443561 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.443524    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.443728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.443702    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:28.444022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.443988    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.444022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444010    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq" pod "dc66a484-bf62-479d-bb11-543ad0798f0b" (UID: "dc66a484-bf62-479d-bb11-543ad0798f0b"). InnerVolumeSpecName "kube-api-access-29lsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.444180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444013    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:28.444180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444055    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.444180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444131    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:28.444640 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444613    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "kube-api-access-zrl57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.444938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.444919    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token" pod "1221d38b-9f05-4322-a00a-e5ee74cde4f8" (UID: "1221d38b-9f05-4322-a00a-e5ee74cde4f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.445444 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.445410    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token" pod "9d37e8c4-5137-4c2c-8c4a-1651903805a9" (UID: "9d37e8c4-5137-4c2c-8c4a-1651903805a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542232    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542263    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542276    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542289    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29lsq\" (UniqueName: \"kubernetes.io/projected/dc66a484-bf62-479d-bb11-543ad0798f0b-kube-api-access-29lsq\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542302    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542315    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542328    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542340    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d37e8c4-5137-4c2c-8c4a-1651903805a9-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542354    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542365    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrl57\" (UniqueName: \"kubernetes.io/projected/9d37e8c4-5137-4c2c-8c4a-1651903805a9-kube-api-access-zrl57\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542397    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc66a484-bf62-479d-bb11-543ad0798f0b-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542410    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9t2\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-kube-api-access-kq9t2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:28.542663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:28.542422    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1221d38b-9f05-4322-a00a-e5ee74cde4f8-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.075480 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.075439    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9" event={"ID":"9d37e8c4-5137-4c2c-8c4a-1651903805a9","Type":"ContainerDied","Data":"6e5e131221803e5c1cc1eaa7311f874120c1b7772b8d24fbd4d3c8101171b808"}
Oct 30 22:14:29.075955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.075516    5967 scope.go:122] "RemoveContainer" containerID="bff4d12ab0c64a23e1d59a67f30f87816b3c3a9bb6ab9811dd361039eb240623"
Oct 30 22:14:29.075955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.075462    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"
Oct 30 22:14:29.077972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.077911    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"
Oct 30 22:14:29.077972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.077944    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2" event={"ID":"dc66a484-bf62-479d-bb11-543ad0798f0b","Type":"ContainerDied","Data":"c85a24988f3d1f5fd3fd1cba68614fc5a4594f6dde90849bf24da718e760296d"}
Oct 30 22:14:29.081387 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.081350    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr" event={"ID":"1221d38b-9f05-4322-a00a-e5ee74cde4f8","Type":"ContainerDied","Data":"e78cb1b57a437c79ff23cbf008e6b92fb86549e3b6e777de5d4b6ceef34ce53a"}
Oct 30 22:14:29.081557 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.081447    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"
Oct 30 22:14:29.105857 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.105645    5967 scope.go:122] "RemoveContainer" containerID="d348b815d826f72752c5687428002563a3be7d0a5da9fa3060ba174867a83600"
Oct 30 22:14:29.119731 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.119705    5967 scope.go:122] "RemoveContainer" containerID="931ab6da84b335df7c7b7954aac2f96185d56becfae0c1154c1d6f87826456bc"
Oct 30 22:14:29.244060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.244027    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:14:29.248901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.248820    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-z5zzr"]
Oct 30 22:14:29.357663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.357634    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:14:29.362904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.362876    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-txvt9"]
Oct 30 22:14:29.475813 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.475775    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:14:29.488426 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:29.488396    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-84wz2"]
Oct 30 22:14:30.069490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:30.069447    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" path="/var/lib/kubelet/pods/1221d38b-9f05-4322-a00a-e5ee74cde4f8/volumes"
Oct 30 22:14:30.070621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:30.070586    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" path="/var/lib/kubelet/pods/9d37e8c4-5137-4c2c-8c4a-1651903805a9/volumes"
Oct 30 22:14:30.071571 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:14:30.071553    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" path="/var/lib/kubelet/pods/dc66a484-bf62-479d-bb11-543ad0798f0b/volumes"
Oct 30 22:14:35.592870 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:14:35.592830    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:15:00.196544 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.196501    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:00.197115 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197100    5967 cpu_manager.go:414] "containerMap: removing container" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy"
Oct 30 22:15:00.197115 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197116    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197133    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197138    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197151    5967 cpu_manager.go:414] "containerMap: removing container" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197156    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197167    5967 cpu_manager.go:414] "containerMap: removing container" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197171    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197191    5967 cpu_manager.go:414] "containerMap: removing container" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy"
Oct 30 22:15:00.197230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197195    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy"
Oct 30 22:15:00.197724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197312    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d37e8c4-5137-4c2c-8c4a-1651903805a9" containerName="istio-proxy"
Oct 30 22:15:00.197724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197320    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d2916b9-83e4-4582-820d-5f321e6aa635" containerName="istio-proxy"
Oct 30 22:15:00.197724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197332    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc66a484-bf62-479d-bb11-543ad0798f0b" containerName="istio-proxy"
Oct 30 22:15:00.197724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197343    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="1221d38b-9f05-4322-a00a-e5ee74cde4f8" containerName="istio-proxy"
Oct 30 22:15:00.197724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.197352    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="54096256-ca0a-49be-919a-816ba85da6b1" containerName="istio-proxy"
Oct 30 22:15:00.201174 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.201154    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:00.201311 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.201285    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.205665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.205643    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.230863 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.230833    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:00.234967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.234950    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.246340 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.246317    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:00.250711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.250692    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.258111 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.258088    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:00.290603 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.290574    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:00.305000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.304974    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:00.314399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.313570    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:00.323676 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323641    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.323816 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323738    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.323816 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323806    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.323942 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323826    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9h6s\" (UniqueName: \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.323942 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323886    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.324050 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.323964    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84ml\" (UniqueName: \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.324106 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.324070    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rrv\" (UniqueName: \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.324165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.324133    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdhqj\" (UniqueName: \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.351137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.351113    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:15:00.425525 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425492    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.425703 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425611    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b84ml\" (UniqueName: \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.425703 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425690    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rrv\" (UniqueName: \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.425790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425777    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdhqj\" (UniqueName: \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.425836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425815    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.425889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425869    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.425943 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425929    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.426004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.425957    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9h6s\" (UniqueName: \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.426291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.426269    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.426546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.426527    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.426756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.426733    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.426793 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.426733    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.491827 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.491794    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84ml\" (UniqueName: \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.492009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.491903    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdhqj\" (UniqueName: \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\") pod \"maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.492009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.491922    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rrv\" (UniqueName: \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\") pod \"maas-api-key-cleanup-29889975-s9prr\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.493530 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.493508    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9h6s\" (UniqueName: \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\") pod \"maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.517550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.517521    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:00.523938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.523917    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:00.549775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.549741    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:00.572425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.572339    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:00.909841 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.909814    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:00.911227 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:00.911202    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4db1a7_ee3d_49ac_8e17_0b9cd80c22ec.slice/crio-5bcfcbbe9b2082f7b4809c84294d639eea7070e9618a70ed679964cd402e0a3b WatchSource:0}: Error finding container 5bcfcbbe9b2082f7b4809c84294d639eea7070e9618a70ed679964cd402e0a3b: Status 404 returned error can't find the container with id 5bcfcbbe9b2082f7b4809c84294d639eea7070e9618a70ed679964cd402e0a3b
Oct 30 22:15:00.963693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.963653    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:00.964363 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:00.964338    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb716bc49_df6f_494e_baf4_f03cf1bfc23b.slice/crio-d81644cf5e031018aa2995756d70d13d425a2789412fa27de82c2fcfb8526228 WatchSource:0}: Error finding container d81644cf5e031018aa2995756d70d13d425a2789412fa27de82c2fcfb8526228: Status 404 returned error can't find the container with id d81644cf5e031018aa2995756d70d13d425a2789412fa27de82c2fcfb8526228
Oct 30 22:15:00.965917 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:00.965893    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165212de_49ce_4684_ab07_4538c38c8461.slice/crio-bb2838af598a631ee57d1c3bb145666887851a8530e8ad6c745cb65781de7808 WatchSource:0}: Error finding container bb2838af598a631ee57d1c3bb145666887851a8530e8ad6c745cb65781de7808: Status 404 returned error can't find the container with id bb2838af598a631ee57d1c3bb145666887851a8530e8ad6c745cb65781de7808
Oct 30 22:15:00.967236 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:00.967218    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:01.016463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:01.016439    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:01.085560 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:01.085516    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd446a465_812c_48bb_b2f5_0d89203179d3.slice/crio-34ed11580f8b739f48b720f3dd23410f00b1cde4335725fb2cf6a3edd5118029 WatchSource:0}: Error finding container 34ed11580f8b739f48b720f3dd23410f00b1cde4335725fb2cf6a3edd5118029: Status 404 returned error can't find the container with id 34ed11580f8b739f48b720f3dd23410f00b1cde4335725fb2cf6a3edd5118029
Oct 30 22:15:01.378814 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:01.378778    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerStarted","Data":"bb2838af598a631ee57d1c3bb145666887851a8530e8ad6c745cb65781de7808"}
Oct 30 22:15:01.380085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:01.380064    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerStarted","Data":"d81644cf5e031018aa2995756d70d13d425a2789412fa27de82c2fcfb8526228"}
Oct 30 22:15:01.381404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:01.381353    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerStarted","Data":"5bcfcbbe9b2082f7b4809c84294d639eea7070e9618a70ed679964cd402e0a3b"}
Oct 30 22:15:01.382728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:01.382700    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerStarted","Data":"34ed11580f8b739f48b720f3dd23410f00b1cde4335725fb2cf6a3edd5118029"}
Oct 30 22:15:02.066877 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:02.066841    5967 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb716bc49_df6f_494e_baf4_f03cf1bfc23b.slice/crio-conmon-0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb716bc49_df6f_494e_baf4_f03cf1bfc23b.slice/crio-0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165212de_49ce_4684_ab07_4538c38c8461.slice/crio-conmon-c3b21da75044bfa6421214b1c02ea6e35004ec0a4c6867407900f353d847f377.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 22:15:02.390221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.390181    5967 generic.go:356] "Generic (PLEG): container finished" podID="165212de-49ce-4684-ab07-4538c38c8461" containerID="c3b21da75044bfa6421214b1c02ea6e35004ec0a4c6867407900f353d847f377" exitCode=60
Oct 30 22:15:02.390736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.390277    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerDied","Data":"c3b21da75044bfa6421214b1c02ea6e35004ec0a4c6867407900f353d847f377"}
Oct 30 22:15:02.390736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.390625    5967 scope.go:122] "RemoveContainer" containerID="c3b21da75044bfa6421214b1c02ea6e35004ec0a4c6867407900f353d847f377"
Oct 30 22:15:02.392030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.392011    5967 generic.go:356] "Generic (PLEG): container finished" podID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerID="0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d" exitCode=60
Oct 30 22:15:02.392137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.392100    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerDied","Data":"0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d"}
Oct 30 22:15:02.392450 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.392341    5967 scope.go:122] "RemoveContainer" containerID="0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d"
Oct 30 22:15:02.393840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.393799    5967 generic.go:356] "Generic (PLEG): container finished" podID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerID="65301ed6fb452e993533ddd3d2ca33ad7a45a3c572554a6c1eba3d732234c1c3" exitCode=60
Oct 30 22:15:02.393901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.393872    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerDied","Data":"65301ed6fb452e993533ddd3d2ca33ad7a45a3c572554a6c1eba3d732234c1c3"}
Oct 30 22:15:02.394225 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.394170    5967 scope.go:122] "RemoveContainer" containerID="65301ed6fb452e993533ddd3d2ca33ad7a45a3c572554a6c1eba3d732234c1c3"
Oct 30 22:15:02.395517 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.395490    5967 generic.go:356] "Generic (PLEG): container finished" podID="d446a465-812c-48bb-b2f5-0d89203179d3" containerID="ef5cb94b566aa69a0936abc100f98735b2c6009adb08cf572888bebd71504de6" exitCode=60
Oct 30 22:15:02.395587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.395570    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerDied","Data":"ef5cb94b566aa69a0936abc100f98735b2c6009adb08cf572888bebd71504de6"}
Oct 30 22:15:02.395790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:02.395774    5967 scope.go:122] "RemoveContainer" containerID="ef5cb94b566aa69a0936abc100f98735b2c6009adb08cf572888bebd71504de6"
Oct 30 22:15:03.406452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.406418    5967 generic.go:356] "Generic (PLEG): container finished" podID="165212de-49ce-4684-ab07-4538c38c8461" containerID="388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3" exitCode=60
Oct 30 22:15:03.406904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.406495    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerDied","Data":"388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3"}
Oct 30 22:15:03.406904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.406564    5967 scope.go:122] "RemoveContainer" containerID="c3b21da75044bfa6421214b1c02ea6e35004ec0a4c6867407900f353d847f377"
Oct 30 22:15:03.407030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.406937    5967 scope.go:122] "RemoveContainer" containerID="388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3"
Oct 30 22:15:03.407419 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:03.407387    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs_odh-ai-gateway-infra(165212de-49ce-4684-ab07-4538c38c8461)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" podUID="165212de-49ce-4684-ab07-4538c38c8461"
Oct 30 22:15:03.408813 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.408787    5967 generic.go:356] "Generic (PLEG): container finished" podID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerID="a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d" exitCode=60
Oct 30 22:15:03.408937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.408906    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerDied","Data":"a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d"}
Oct 30 22:15:03.409183 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.409154    5967 scope.go:122] "RemoveContainer" containerID="a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d"
Oct 30 22:15:03.409639 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:03.409572    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq_odh-ai-gateway-infra(b716bc49-df6f-494e-baf4-f03cf1bfc23b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b"
Oct 30 22:15:03.411307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.411283    5967 generic.go:356] "Generic (PLEG): container finished" podID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerID="df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074" exitCode=60
Oct 30 22:15:03.411439 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.411400    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerDied","Data":"df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074"}
Oct 30 22:15:03.411770 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.411752    5967 scope.go:122] "RemoveContainer" containerID="df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074"
Oct 30 22:15:03.412179 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:03.412108    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx_odh-ai-gateway-infra(2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec"
Oct 30 22:15:03.413827 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.413806    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerStarted","Data":"fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"}
Oct 30 22:15:03.561182 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.561159    5967 scope.go:122] "RemoveContainer" containerID="0fe48facd0edcc0723794f74a8944029a014cb82787a2ee77318eb1331512f7d"
Oct 30 22:15:03.574215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.574189    5967 scope.go:122] "RemoveContainer" containerID="65301ed6fb452e993533ddd3d2ca33ad7a45a3c572554a6c1eba3d732234c1c3"
Oct 30 22:15:03.640183 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:03.640126    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" podStartSLOduration=3.640111438 podStartE2EDuration="3.640111438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:03.639012411 +0000 UTC m=+1791.753720776" watchObservedRunningTime="2026-10-30 22:15:03.640111438 +0000 UTC m=+1791.754819788"
Oct 30 22:15:04.423505 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.423425    5967 scope.go:122] "RemoveContainer" containerID="388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3"
Oct 30 22:15:04.423979 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:04.423841    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs_odh-ai-gateway-infra(165212de-49ce-4684-ab07-4538c38c8461)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" podUID="165212de-49ce-4684-ab07-4538c38c8461"
Oct 30 22:15:04.425798 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.425773    5967 scope.go:122] "RemoveContainer" containerID="a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d"
Oct 30 22:15:04.426144 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:04.426121    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq_odh-ai-gateway-infra(b716bc49-df6f-494e-baf4-f03cf1bfc23b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b"
Oct 30 22:15:04.427386 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.427350    5967 scope.go:122] "RemoveContainer" containerID="df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074"
Oct 30 22:15:04.427658 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:04.427639    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx_odh-ai-gateway-infra(2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec"
Oct 30 22:15:04.428944 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.428919    5967 generic.go:356] "Generic (PLEG): container finished" podID="d446a465-812c-48bb-b2f5-0d89203179d3" containerID="fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e" exitCode=60
Oct 30 22:15:04.429030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.428953    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerDied","Data":"fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"}
Oct 30 22:15:04.429030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.429027    5967 scope.go:122] "RemoveContainer" containerID="ef5cb94b566aa69a0936abc100f98735b2c6009adb08cf572888bebd71504de6"
Oct 30 22:15:04.429281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:04.429257    5967 scope.go:122] "RemoveContainer" containerID="fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"
Oct 30 22:15:04.429554 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:04.429534    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-s9prr_odh-ai-gateway-infra(d446a465-812c-48bb-b2f5-0d89203179d3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" podUID="d446a465-812c-48bb-b2f5-0d89203179d3"
Oct 30 22:15:05.438193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:05.438164    5967 scope.go:122] "RemoveContainer" containerID="fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"
Oct 30 22:15:05.438670 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:05.438603    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-s9prr_odh-ai-gateway-infra(d446a465-812c-48bb-b2f5-0d89203179d3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" podUID="d446a465-812c-48bb-b2f5-0d89203179d3"
Oct 30 22:15:05.593156 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:05.593116    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:15:09.482296 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.482262    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:15:09.487747 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.487729    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.540341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.540315    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2d8852-serving-cert\""
Oct 30 22:15:09.573259 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.573223    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.573486 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.573465    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68rb\" (UniqueName: \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.573549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.573525    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.573640 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.573626    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.593316 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.593293    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:15:09.675139 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.675097    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68rb\" (UniqueName: \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.675322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.675195    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.675322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.675307    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.675456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.675443    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.675597 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:09.675578    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-serving-cert: secret "maas-api-e2e-shared-a-w3-2d8852-serving-cert" not found
Oct 30 22:15:09.675667 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:09.675658    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls podName:a10631d8-ccc5-451e-af3e-279209822140 nodeName:}" failed. No retries permitted until 2026-10-30 22:15:10.175640468 +0000 UTC m=+1798.290348817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls") pod "maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" (UID: "a10631d8-ccc5-451e-af3e-279209822140") : secret "maas-api-e2e-shared-a-w3-2d8852-serving-cert" not found
Oct 30 22:15:09.675946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.675928    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.677958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.677935    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:09.742215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:09.739032    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68rb\" (UniqueName: \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:10.185641 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:10.185553    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:10.188318 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:10.188292    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:10.401818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:10.401787    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:10.783814 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:10.783786    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:15:10.784799 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:10.784764    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10631d8_ccc5_451e_af3e_279209822140.slice/crio-e8d074842128f91636112b37a46e28cf55a30e25a3197a0fa0b3d740ef0f76f5 WatchSource:0}: Error finding container e8d074842128f91636112b37a46e28cf55a30e25a3197a0fa0b3d740ef0f76f5: Status 404 returned error can't find the container with id e8d074842128f91636112b37a46e28cf55a30e25a3197a0fa0b3d740ef0f76f5
Oct 30 22:15:11.484287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:11.484254    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" event={"ID":"a10631d8-ccc5-451e-af3e-279209822140","Type":"ContainerStarted","Data":"e8d074842128f91636112b37a46e28cf55a30e25a3197a0fa0b3d740ef0f76f5"}
Oct 30 22:15:12.493106 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:12.493063    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" event={"ID":"a10631d8-ccc5-451e-af3e-279209822140","Type":"ContainerStarted","Data":"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"}
Oct 30 22:15:12.493675 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:12.493297    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:12.657915 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:12.657857    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" podStartSLOduration=2.8344780590000003 podStartE2EDuration="3.657843536s" totalImagesPullingTime="823.365477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:12.654689037 +0000 UTC m=+1800.769397414" watchObservedRunningTime="2026-10-30 22:15:12.657843536 +0000 UTC m=+1800.772551887"
Oct 30 22:15:15.011268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:15.011232    5967 scope.go:122] "RemoveContainer" containerID="fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"
Oct 30 22:15:15.152935 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:15.152909    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:15:15.156840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:15.156805    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:15:15.513181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:15.513139    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerStarted","Data":"1a6c853721adf8beda99121bfdce0a379701ace9deba61bf62b280a285f536e9"}
Oct 30 22:15:16.011035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.011000    5967 scope.go:122] "RemoveContainer" containerID="388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3"
Oct 30 22:15:16.011179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.011137    5967 scope.go:122] "RemoveContainer" containerID="df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074"
Oct 30 22:15:16.011333 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.011312    5967 scope.go:122] "RemoveContainer" containerID="a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d"
Oct 30 22:15:16.522031 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.521989    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerStarted","Data":"2ebe95020fa69a3754d8629162eeaae59902418382dae9edf04b5b493e252b89"}
Oct 30 22:15:16.524160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.524134    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerStarted","Data":"f6d83768ff5e04fde299e5a3a69554f93dca52fb9c1f432b74397b3d27ff252e"}
Oct 30 22:15:16.525996 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.525973    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerStarted","Data":"97de8cd1013668f4e42df1143a01ed99aaadbe577139330b267b2fa7c0be6a15"}
Oct 30 22:15:16.527864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.527838    5967 generic.go:356] "Generic (PLEG): container finished" podID="d446a465-812c-48bb-b2f5-0d89203179d3" containerID="1a6c853721adf8beda99121bfdce0a379701ace9deba61bf62b280a285f536e9" exitCode=60
Oct 30 22:15:16.527948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.527905    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerDied","Data":"1a6c853721adf8beda99121bfdce0a379701ace9deba61bf62b280a285f536e9"}
Oct 30 22:15:16.528005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.527953    5967 scope.go:122] "RemoveContainer" containerID="fa4bd82872d1ff617b75b9c4823d789d3964f0096a7d2fb23382976f196e479e"
Oct 30 22:15:16.528229 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.528213    5967 scope.go:122] "RemoveContainer" containerID="1a6c853721adf8beda99121bfdce0a379701ace9deba61bf62b280a285f536e9"
Oct 30 22:15:16.528523 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:16.528503    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-s9prr_odh-ai-gateway-infra(d446a465-812c-48bb-b2f5-0d89203179d3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" podUID="d446a465-812c-48bb-b2f5-0d89203179d3"
Oct 30 22:15:16.640037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.639936    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:16.640288 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.640248    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" podStartSLOduration=16.640235216 podStartE2EDuration="16.640235216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:16.639918197 +0000 UTC m=+1804.754626548" watchObservedRunningTime="2026-10-30 22:15:16.640235216 +0000 UTC m=+1804.754943638"
Oct 30 22:15:16.870663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.870485    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" podStartSLOduration=16.87046367 podStartE2EDuration="16.87046367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:16.869832074 +0000 UTC m=+1804.984540426" watchObservedRunningTime="2026-10-30 22:15:16.87046367 +0000 UTC m=+1804.985172025"
Oct 30 22:15:16.987983 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:16.987907    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" podStartSLOduration=16.987888426 podStartE2EDuration="16.987888426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:16.986458574 +0000 UTC m=+1805.101166924" watchObservedRunningTime="2026-10-30 22:15:16.987888426 +0000 UTC m=+1805.102596777"
Oct 30 22:15:17.536802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.536765    5967 generic.go:356] "Generic (PLEG): container finished" podID="165212de-49ce-4684-ab07-4538c38c8461" containerID="2ebe95020fa69a3754d8629162eeaae59902418382dae9edf04b5b493e252b89" exitCode=60
Oct 30 22:15:17.537284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.536847    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerDied","Data":"2ebe95020fa69a3754d8629162eeaae59902418382dae9edf04b5b493e252b89"}
Oct 30 22:15:17.537284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.536920    5967 scope.go:122] "RemoveContainer" containerID="388d95c9eec06e4bd568cd17efd879ffa4634266f6fc4389572fbf4cccb002d3"
Oct 30 22:15:17.537448 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.537425    5967 scope.go:122] "RemoveContainer" containerID="2ebe95020fa69a3754d8629162eeaae59902418382dae9edf04b5b493e252b89"
Oct 30 22:15:17.537859 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:17.537815    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs_odh-ai-gateway-infra(165212de-49ce-4684-ab07-4538c38c8461)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" podUID="165212de-49ce-4684-ab07-4538c38c8461"
Oct 30 22:15:17.539261 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.539235    5967 generic.go:356] "Generic (PLEG): container finished" podID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerID="f6d83768ff5e04fde299e5a3a69554f93dca52fb9c1f432b74397b3d27ff252e" exitCode=60
Oct 30 22:15:17.539356 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.539314    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerDied","Data":"f6d83768ff5e04fde299e5a3a69554f93dca52fb9c1f432b74397b3d27ff252e"}
Oct 30 22:15:17.539794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.539774    5967 scope.go:122] "RemoveContainer" containerID="f6d83768ff5e04fde299e5a3a69554f93dca52fb9c1f432b74397b3d27ff252e"
Oct 30 22:15:17.540196 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:17.540169    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq_odh-ai-gateway-infra(b716bc49-df6f-494e-baf4-f03cf1bfc23b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b"
Oct 30 22:15:17.541758 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.541731    5967 generic.go:356] "Generic (PLEG): container finished" podID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerID="97de8cd1013668f4e42df1143a01ed99aaadbe577139330b267b2fa7c0be6a15" exitCode=60
Oct 30 22:15:17.541939 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.541909    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerDied","Data":"97de8cd1013668f4e42df1143a01ed99aaadbe577139330b267b2fa7c0be6a15"}
Oct 30 22:15:17.542469 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.542450    5967 scope.go:122] "RemoveContainer" containerID="97de8cd1013668f4e42df1143a01ed99aaadbe577139330b267b2fa7c0be6a15"
Oct 30 22:15:17.542872 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:17.542842    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx_odh-ai-gateway-infra(2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec"
Oct 30 22:15:17.551901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.551867    5967 scope.go:122] "RemoveContainer" containerID="a0c0ec19661f269d39d8647600b0dd0d00fb73b6d307381acc11ef318556118d"
Oct 30 22:15:17.567914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.567889    5967 scope.go:122] "RemoveContainer" containerID="df1f15ed17b302320e33a2f7da01387786ac33997e45f000c5afadb40efd9074"
Oct 30 22:15:17.651862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.651830    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:17.725545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.725516    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:17.815170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.815092    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\") pod \"d446a465-812c-48bb-b2f5-0d89203179d3\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") "
Oct 30 22:15:17.815170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.815166    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\" (UniqueName: \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\") pod \"d446a465-812c-48bb-b2f5-0d89203179d3\" (UID: \"d446a465-812c-48bb-b2f5-0d89203179d3\") "
Oct 30 22:15:17.815567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.815543    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca" pod "d446a465-812c-48bb-b2f5-0d89203179d3" (UID: "d446a465-812c-48bb-b2f5-0d89203179d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:17.815741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.815726    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d446a465-812c-48bb-b2f5-0d89203179d3-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.817488 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.817472    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv" pod "d446a465-812c-48bb-b2f5-0d89203179d3" (UID: "d446a465-812c-48bb-b2f5-0d89203179d3"). InnerVolumeSpecName "kube-api-access-f5rrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:17.882446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.882418    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:17.916850 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.916819    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5rrv\" (UniqueName: \"kubernetes.io/projected/d446a465-812c-48bb-b2f5-0d89203179d3-kube-api-access-f5rrv\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.996677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:17.996647    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:18.506014 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.505986    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:15:18.558142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.558107    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr" event={"ID":"d446a465-812c-48bb-b2f5-0d89203179d3","Type":"ContainerDied","Data":"34ed11580f8b739f48b720f3dd23410f00b1cde4335725fb2cf6a3edd5118029"}
Oct 30 22:15:18.558549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.558193    5967 scope.go:122] "RemoveContainer" containerID="1a6c853721adf8beda99121bfdce0a379701ace9deba61bf62b280a285f536e9"
Oct 30 22:15:18.558549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.558341    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"
Oct 30 22:15:18.766782 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.766702    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:18.831885 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.831835    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\") pod \"165212de-49ce-4684-ab07-4538c38c8461\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") "
Oct 30 22:15:18.832132 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.832117    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\" (UniqueName: \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\") pod \"165212de-49ce-4684-ab07-4538c38c8461\" (UID: \"165212de-49ce-4684-ab07-4538c38c8461\") "
Oct 30 22:15:18.832188 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.832148    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca" pod "165212de-49ce-4684-ab07-4538c38c8461" (UID: "165212de-49ce-4684-ab07-4538c38c8461"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:18.832860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.832816    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165212de-49ce-4684-ab07-4538c38c8461-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.834330 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.834303    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s" pod "165212de-49ce-4684-ab07-4538c38c8461" (UID: "165212de-49ce-4684-ab07-4538c38c8461"). InnerVolumeSpecName "kube-api-access-p9h6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:18.861553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.861527    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:18.867662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.867636    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:18.933663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.933631    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\") pod \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") "
Oct 30 22:15:18.933861 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.933697    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\" (UniqueName: \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\") pod \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\" (UID: \"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec\") "
Oct 30 22:15:18.933861 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.933832    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\" (UniqueName: \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\") pod \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") "
Oct 30 22:15:18.933981 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.933906    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\") pod \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\" (UID: \"b716bc49-df6f-494e-baf4-f03cf1bfc23b\") "
Oct 30 22:15:18.934060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.934034    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca" pod "2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" (UID: "2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:18.934231 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.934206    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca" pod "b716bc49-df6f-494e-baf4-f03cf1bfc23b" (UID: "b716bc49-df6f-494e-baf4-f03cf1bfc23b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:18.934485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.934470    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.934535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.934500    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9h6s\" (UniqueName: \"kubernetes.io/projected/165212de-49ce-4684-ab07-4538c38c8461-kube-api-access-p9h6s\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.934535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.934514    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b716bc49-df6f-494e-baf4-f03cf1bfc23b-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.936066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.936048    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj" pod "2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" (UID: "2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec"). InnerVolumeSpecName "kube-api-access-gdhqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:18.936126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.936075    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml" pod "b716bc49-df6f-494e-baf4-f03cf1bfc23b" (UID: "b716bc49-df6f-494e-baf4-f03cf1bfc23b"). InnerVolumeSpecName "kube-api-access-b84ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:18.979504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.979473    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:18.983930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:18.983903    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-s9prr"]
Oct 30 22:15:19.035795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.035717    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdhqj\" (UniqueName: \"kubernetes.io/projected/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec-kube-api-access-gdhqj\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:19.035795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.035746    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b84ml\" (UniqueName: \"kubernetes.io/projected/b716bc49-df6f-494e-baf4-f03cf1bfc23b-kube-api-access-b84ml\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:19.565752 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.565721    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"
Oct 30 22:15:19.566230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.565718    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs" event={"ID":"165212de-49ce-4684-ab07-4538c38c8461","Type":"ContainerDied","Data":"bb2838af598a631ee57d1c3bb145666887851a8530e8ad6c745cb65781de7808"}
Oct 30 22:15:19.566230 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.565856    5967 scope.go:122] "RemoveContainer" containerID="2ebe95020fa69a3754d8629162eeaae59902418382dae9edf04b5b493e252b89"
Oct 30 22:15:19.567135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.567118    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"
Oct 30 22:15:19.567206 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.567156    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq" event={"ID":"b716bc49-df6f-494e-baf4-f03cf1bfc23b","Type":"ContainerDied","Data":"d81644cf5e031018aa2995756d70d13d425a2789412fa27de82c2fcfb8526228"}
Oct 30 22:15:19.568989 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.568958    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx" event={"ID":"2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec","Type":"ContainerDied","Data":"5bcfcbbe9b2082f7b4809c84294d639eea7070e9618a70ed679964cd402e0a3b"}
Oct 30 22:15:19.569095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.569051    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"
Oct 30 22:15:19.578630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.578609    5967 scope.go:122] "RemoveContainer" containerID="f6d83768ff5e04fde299e5a3a69554f93dca52fb9c1f432b74397b3d27ff252e"
Oct 30 22:15:19.588395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.588356    5967 scope.go:122] "RemoveContainer" containerID="97de8cd1013668f4e42df1143a01ed99aaadbe577139330b267b2fa7c0be6a15"
Oct 30 22:15:19.731294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.731266    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:19.735607 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.735580    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b2f165-29889975-9zlqs"]
Oct 30 22:15:19.850680 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.850601    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:19.853632 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.853608    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889975-tl2mq"]
Oct 30 22:15:19.958061 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.958030    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:19.963809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:19.963785    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-536975-29889975-9c4cx"]
Oct 30 22:15:20.020075 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:20.020035    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="165212de-49ce-4684-ab07-4538c38c8461" path="/var/lib/kubelet/pods/165212de-49ce-4684-ab07-4538c38c8461/volumes"
Oct 30 22:15:20.020535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:20.020514    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" path="/var/lib/kubelet/pods/2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec/volumes"
Oct 30 22:15:20.021087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:20.021065    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" path="/var/lib/kubelet/pods/b716bc49-df6f-494e-baf4-f03cf1bfc23b/volumes"
Oct 30 22:15:20.021919 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:20.021899    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" path="/var/lib/kubelet/pods/d446a465-812c-48bb-b2f5-0d89203179d3/volumes"
Oct 30 22:15:29.570120 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570085    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:15:29.570733 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570717    5967 cpu_manager.go:414] "containerMap: removing container" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570733 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570733    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570746    5967 cpu_manager.go:414] "containerMap: removing container" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570751    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570760    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570764    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570789    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570794    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570811    5967 cpu_manager.go:414] "containerMap: removing container" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570816    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570822    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570826    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570833    5967 cpu_manager.go:414] "containerMap: removing container" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570837    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570843    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570848    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570855    5967 cpu_manager.go:414] "containerMap: removing container" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570859    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570944    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570954    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570959    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570963    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570970    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570977    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570982    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570988    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.570986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.570994    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="b716bc49-df6f-494e-baf4-f03cf1bfc23b" containerName="cleanup"
Oct 30 22:15:29.571547 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.571001    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:29.571547 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.571006    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:29.576067 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.576046    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.630639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.630613    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3b355441-serving-cert\""
Oct 30 22:15:29.685704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.685672    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:15:29.688307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.688279    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.688552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.688534    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mqb\" (UniqueName: \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.688687 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.688668    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.688802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.688788    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.790489 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.790459    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.790674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.790594    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mqb\" (UniqueName: \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.790674 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:29.790621    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-serving-cert: secret "maas-api-e2e-mt-3b355441-serving-cert" not found
Oct 30 22:15:29.790761 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:29.790687    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls podName:a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa nodeName:}" failed. No retries permitted until 2026-10-30 22:15:30.29066575 +0000 UTC m=+1818.405374098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls") pod "maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" (UID: "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa") : secret "maas-api-e2e-mt-3b355441-serving-cert" not found
Oct 30 22:15:29.790761 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.790711    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.790854 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.790824    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.791522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.791486    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.793436 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.793414    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:29.867532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:29.867451    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mqb\" (UniqueName: \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:30.299252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:30.299217    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:30.301923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:30.301891    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") pod \"maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:30.490123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:30.490082    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:30.873030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:30.873005    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:15:30.875124 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:30.875094    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75c9db6_ef2a_4e29_a8ca_f9aa8d90e2fa.slice/crio-9913837c5c2d03ff476107c58a302e80546e721d63718c88ecc7d7567f43c897 WatchSource:0}: Error finding container 9913837c5c2d03ff476107c58a302e80546e721d63718c88ecc7d7567f43c897: Status 404 returned error can't find the container with id 9913837c5c2d03ff476107c58a302e80546e721d63718c88ecc7d7567f43c897
Oct 30 22:15:31.680466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:31.680426    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" event={"ID":"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa","Type":"ContainerStarted","Data":"9913837c5c2d03ff476107c58a302e80546e721d63718c88ecc7d7567f43c897"}
Oct 30 22:15:32.689126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:32.689090    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" event={"ID":"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa","Type":"ContainerStarted","Data":"45d298561421ae6537a428f83b41689ca0184ded8739156c677bd58099e4432a"}
Oct 30 22:15:32.689658 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:32.689177    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:32.808495 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:32.808434    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" podStartSLOduration=2.973786604 podStartE2EDuration="3.808415796s" totalImagesPullingTime="834.629192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:32.806232912 +0000 UTC m=+1820.920941267" watchObservedRunningTime="2026-10-30 22:15:32.808415796 +0000 UTC m=+1820.923124148"
Oct 30 22:15:35.593836 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:35.593796    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:15:38.700710 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:38.700679    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:15:45.048478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.048439    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:15:45.049110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049096    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:45.049157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049111    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:45.049157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049129    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:45.049157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049134    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e4db1a7-ee3d-49ac-8e17-0b9cd80c22ec" containerName="cleanup"
Oct 30 22:15:45.049252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049160    5967 cpu_manager.go:414] "containerMap: removing container" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:45.049252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049166    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="165212de-49ce-4684-ab07-4538c38c8461" containerName="cleanup"
Oct 30 22:15:45.049335 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.049324    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d446a465-812c-48bb-b2f5-0d89203179d3" containerName="cleanup"
Oct 30 22:15:45.053771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.053739    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.065668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.065644    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.065788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.065767    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.065841 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.065827    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.066012 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.065997    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf8xq\" (UniqueName: \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.108464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.108427    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w5-9a96b4-serving-cert\""
Oct 30 22:15:45.112906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.112879    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:15:45.167280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.167250    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf8xq\" (UniqueName: \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.167549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.167311    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.167549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.167399    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.167549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.167458    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.167729 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:45.167559    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-serving-cert: secret "maas-api-e2e-shared-a-w5-9a96b4-serving-cert" not found
Oct 30 22:15:45.167729 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:15:45.167632    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls podName:85b278f9-7ee1-48fa-856d-0972ed08cefe nodeName:}" failed. No retries permitted until 2026-10-30 22:15:45.667616584 +0000 UTC m=+1833.782324930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls") pod "maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" (UID: "85b278f9-7ee1-48fa-856d-0972ed08cefe") : secret "maas-api-e2e-shared-a-w5-9a96b4-serving-cert" not found
Oct 30 22:15:45.168173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.168150    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.170464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.170444    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.229090 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.229062    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf8xq\" (UniqueName: \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.674301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.674265    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.676841 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.676812    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:45.968586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:45.968560    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:46.347807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:46.347775    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:15:46.348154 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:15:46.347895    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b278f9_7ee1_48fa_856d_0972ed08cefe.slice/crio-610a0cad002a3480c82af874fd8531d2580843da937ffe46ea1e52b1783e149c WatchSource:0}: Error finding container 610a0cad002a3480c82af874fd8531d2580843da937ffe46ea1e52b1783e149c: Status 404 returned error can't find the container with id 610a0cad002a3480c82af874fd8531d2580843da937ffe46ea1e52b1783e149c
Oct 30 22:15:46.349512 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:46.349492    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:15:46.795472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:46.795428    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" event={"ID":"85b278f9-7ee1-48fa-856d-0972ed08cefe","Type":"ContainerStarted","Data":"610a0cad002a3480c82af874fd8531d2580843da937ffe46ea1e52b1783e149c"}
Oct 30 22:15:47.804587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:47.804550    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" event={"ID":"85b278f9-7ee1-48fa-856d-0972ed08cefe","Type":"ContainerStarted","Data":"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"}
Oct 30 22:15:47.805025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:47.804738    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:47.928086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:47.928031    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" podStartSLOduration=2.080208934 podStartE2EDuration="2.928018361s" totalImagesPullingTime="847.809427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:47.924549413 +0000 UTC m=+1836.039257758" watchObservedRunningTime="2026-10-30 22:15:47.928018361 +0000 UTC m=+1836.042726743"
Oct 30 22:15:50.596079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:50.596043    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:15:50.596551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:50.596312    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy" containerID="cri-o://2ad6001559d86563d111355722385f829007bf81bbb3998531c3bc717bf277b9" gracePeriod=30
Oct 30 22:15:53.816077 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:53.816049    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:15:55.859553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:55.859479    5967 generic.go:356] "Generic (PLEG): container finished" podID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerID="2ad6001559d86563d111355722385f829007bf81bbb3998531c3bc717bf277b9" exitCode=0
Oct 30 22:15:55.859553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:55.859522    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" event={"ID":"5c384f68-f9d4-4cbe-b93b-6994ecaaf208","Type":"ContainerDied","Data":"2ad6001559d86563d111355722385f829007bf81bbb3998531c3bc717bf277b9"}
Oct 30 22:15:55.859952 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:55.859560    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz" event={"ID":"5c384f68-f9d4-4cbe-b93b-6994ecaaf208","Type":"ContainerDied","Data":"6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5"}
Oct 30 22:15:55.859952 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:55.859576    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aeede3dd4302d1c2bbb8e0b0c236affb4a23682c804b0c8b3e0a53d89aa22f5"
Oct 30 22:15:55.877506 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:55.877476    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:15:56.037329 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037302    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037514 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037336    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037514 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037479    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037583    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037616    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.037750 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037641    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037750 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037708    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037750 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037743    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037770    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037782    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.037911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037803    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\") pod \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\" (UID: \"5c384f68-f9d4-4cbe-b93b-6994ecaaf208\") "
Oct 30 22:15:56.037911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037813    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:56.038088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.037983    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.038088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038003    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.038697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038670    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.038815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038699    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.038815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038714    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.038815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038728    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.038815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.038742    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.040168 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.040143    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:56.040281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.040231    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.040281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.040249    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "kube-api-access-vhfww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.040281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.040272    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token" pod "5c384f68-f9d4-4cbe-b93b-6994ecaaf208" (UID: "5c384f68-f9d4-4cbe-b93b-6994ecaaf208"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.140573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.140493    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.140573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.140526    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhfww\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-kube-api-access-vhfww\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.140573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.140542    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.140573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.140554    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c384f68-f9d4-4cbe-b93b-6994ecaaf208-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.865978 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:56.865948    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"
Oct 30 22:15:57.083066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:57.083031    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:15:57.132780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:57.132708    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-c9jlz"]
Oct 30 22:15:58.019975 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:15:58.019940    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" path="/var/lib/kubelet/pods/5c384f68-f9d4-4cbe-b93b-6994ecaaf208/volumes"
Oct 30 22:16:05.602241 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:16:05.602158    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:16:13.013073 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:13.013042    5967 scope.go:122] "RemoveContainer" containerID="2ad6001559d86563d111355722385f829007bf81bbb3998531c3bc717bf277b9"
Oct 30 22:16:19.777616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:19.777573    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:16:19.778136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:19.777843    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" containerID="cri-o://d3f43049808db65787f050e8e01bfb2c5ee8cae6b23ff547c070a762fd0280fe" gracePeriod=30
Oct 30 22:16:20.077503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:20.077413    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:16:20.077667 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:20.077625    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" containerID="cri-o://eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13" gracePeriod=30
Oct 30 22:16:24.994482 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:24.994444    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:16:24.995104 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:24.995066    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:16:25.074837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:25.074748    5967 generic.go:356] "Generic (PLEG): container finished" podID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerID="d3f43049808db65787f050e8e01bfb2c5ee8cae6b23ff547c070a762fd0280fe" exitCode=0
Oct 30 22:16:25.074837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:25.074822    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" event={"ID":"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c","Type":"ContainerDied","Data":"d3f43049808db65787f050e8e01bfb2c5ee8cae6b23ff547c070a762fd0280fe"}
Oct 30 22:16:26.029001 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:25.998445    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:16:26.046301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.046273    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:16:26.083095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.083065    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h" event={"ID":"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c","Type":"ContainerDied","Data":"d3b72385f81cdfa8e9a3aa841aca27e435d9464540f01c29b1bcd487e32b7d42"}
Oct 30 22:16:26.083277 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.083129    5967 scope.go:122] "RemoveContainer" containerID="d3f43049808db65787f050e8e01bfb2c5ee8cae6b23ff547c070a762fd0280fe"
Oct 30 22:16:26.083277 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.083077    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"
Oct 30 22:16:26.084815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.084787    5967 generic.go:356] "Generic (PLEG): container finished" podID="16b34af5-e750-46a0-b679-24bfd704731d" containerID="eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13" exitCode=0
Oct 30 22:16:26.084917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.084848    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"
Oct 30 22:16:26.084917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.084878    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" event={"ID":"16b34af5-e750-46a0-b679-24bfd704731d","Type":"ContainerDied","Data":"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"}
Oct 30 22:16:26.085021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.084927    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" event={"ID":"16b34af5-e750-46a0-b679-24bfd704731d","Type":"ContainerDied","Data":"dd2d2253a0e20bf80698b9b3aa44a2ea356df60c042f72b3776452c41ae60e4c"}
Oct 30 22:16:26.094325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.094305    5967 scope.go:122] "RemoveContainer" containerID="eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"
Oct 30 22:16:26.106348 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.106322    5967 scope.go:122] "RemoveContainer" containerID="eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"
Oct 30 22:16:26.106627 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:16:26.106609    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13\": container with ID starting with eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13 not found: ID does not exist" containerID="eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"
Oct 30 22:16:26.106693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.106634    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13"} err="failed to get container status \"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13\": rpc error: code = NotFound desc = could not find container \"eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13\": container with ID starting with eadb21468fbb270ac97e1fcf6ae3f8ff926129159a3c19ea3b3f8f73d21e2c13 not found: ID does not exist"
Oct 30 22:16:26.142754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.142732    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.142906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.142787    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.142906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.142819    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143024 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.142980    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.143083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143044    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.143142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143108    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143220 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143172    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.143278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143225    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143106    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.143406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143296    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143298    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.143406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143338    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143448    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143547    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143570    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143609    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143656    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143659    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.143727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143690    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.144087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143767    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.144087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143804    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\") pod \"16b34af5-e750-46a0-b679-24bfd704731d\" (UID: \"16b34af5-e750-46a0-b679-24bfd704731d\") "
Oct 30 22:16:26.144087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143841    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\") pod \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\" (UID: \"68e9d472-eba4-4ea1-abb6-847c3c9bdd1c\") "
Oct 30 22:16:26.144087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143852    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.144087 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.143893    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.144334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144111    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.144453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144421    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:26.144802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144779    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144805    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144823    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144837    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144852    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144867    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144881    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.144911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.144896    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.145963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.145212    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.145963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.145856    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:26.145963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.145886    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:26.146224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.146194    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.146224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.146205    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:26.148126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.147919    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:26.148126 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.147936    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "kube-api-access-kjvzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:26.148252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.148146    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo" pod "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" (UID: "68e9d472-eba4-4ea1-abb6-847c3c9bdd1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:26.148252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.148149    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "kube-api-access-fv52h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:26.148833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.148815    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy" pod "16b34af5-e750-46a0-b679-24bfd704731d" (UID: "16b34af5-e750-46a0-b679-24bfd704731d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.247920    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjvzt\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-kube-api-access-kjvzt\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.247954    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv52h\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-kube-api-access-fv52h\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.247981    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b34af5-e750-46a0-b679-24bfd704731d-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.247997    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b34af5-e750-46a0-b679-24bfd704731d-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248012    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248025    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b34af5-e750-46a0-b679-24bfd704731d-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248044    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248059    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248073    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b34af5-e750-46a0-b679-24bfd704731d-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.252089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.248088    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:26.435445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.435415    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:16:26.435598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.435469    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:26.526488 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.526452    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:16:26.529959 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.529933    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-97c8h"]
Oct 30 22:16:26.642671 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.642638    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:16:26.645468 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:26.645439    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mr4jx"]
Oct 30 22:16:28.025502 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:28.025468    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16b34af5-e750-46a0-b679-24bfd704731d" path="/var/lib/kubelet/pods/16b34af5-e750-46a0-b679-24bfd704731d/volumes"
Oct 30 22:16:28.026222 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:28.026201    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" path="/var/lib/kubelet/pods/68e9d472-eba4-4ea1-abb6-847c3c9bdd1c/volumes"
Oct 30 22:16:35.594635 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:16:35.594590    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:16:43.410819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:43.408866    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:16:43.411689 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:43.411636    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy" containerID="cri-o://ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0" gracePeriod=30
Oct 30 22:16:48.686193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.686167    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:16:48.851681 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.851642    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.851889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.851690    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.851889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.851729    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.851889    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.851948    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852023    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852059    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:48.852215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852132    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852196    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852240    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:48.852355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852247    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\") pod \"784da18a-807b-4a3d-9c61-6d354ac6d000\" (UID: \"784da18a-807b-4a3d-9c61-6d354ac6d000\") "
Oct 30 22:16:48.852570 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852549    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:48.852881 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852846    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:48.853116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.852988    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:48.853409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.853384    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784da18a-807b-4a3d-9c61-6d354ac6d000-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.853508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.853414    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.853508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.853430    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.853508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.853444    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.853508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.853468    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.854237 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.854214    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:48.854425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.854402    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:48.854515 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.854443    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "kube-api-access-rcrfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:48.854695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.854671    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token" pod "784da18a-807b-4a3d-9c61-6d354ac6d000" (UID: "784da18a-807b-4a3d-9c61-6d354ac6d000"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:48.954940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.954892    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcrfm\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-kube-api-access-rcrfm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.954940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.954932    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.954940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.954949    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:48.955195 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:48.954961    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784da18a-807b-4a3d-9c61-6d354ac6d000-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.256817 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.256785    5967 generic.go:356] "Generic (PLEG): container finished" podID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerID="ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0" exitCode=0
Oct 30 22:16:49.257038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.256833    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"
Oct 30 22:16:49.257038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.256847    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" event={"ID":"784da18a-807b-4a3d-9c61-6d354ac6d000","Type":"ContainerDied","Data":"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"}
Oct 30 22:16:49.257038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.256899    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw" event={"ID":"784da18a-807b-4a3d-9c61-6d354ac6d000","Type":"ContainerDied","Data":"ab28ed2de2442edc5b7d281c366d954f072437513bb1e93e56059583fa814b40"}
Oct 30 22:16:49.257038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.256923    5967 scope.go:122] "RemoveContainer" containerID="ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"
Oct 30 22:16:49.271360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.270359    5967 scope.go:122] "RemoveContainer" containerID="ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"
Oct 30 22:16:49.271771 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:16:49.271748    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0\": container with ID starting with ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0 not found: ID does not exist" containerID="ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"
Oct 30 22:16:49.271859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.271786    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0"} err="failed to get container status \"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0\": rpc error: code = NotFound desc = could not find container \"ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0\": container with ID starting with ef4d11b6d482c62ba0272eb780a0f42d2ec695d31e0336a05f6bce36dbebb2e0 not found: ID does not exist"
Oct 30 22:16:49.423833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.423797    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:16:49.473617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:49.473583    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-9rlgw"]
Oct 30 22:16:50.019108 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:50.019071    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" path="/var/lib/kubelet/pods/784da18a-807b-4a3d-9c61-6d354ac6d000/volumes"
Oct 30 22:16:58.530222 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:58.530185    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:16:58.530626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:58.530416    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy" containerID="cri-o://4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f" gracePeriod=30
Oct 30 22:16:58.580717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:58.580685    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:16:58.580925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:16:58.580890    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy" containerID="cri-o://637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed" gracePeriod=30
Oct 30 22:17:03.869770 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.869743    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:17:03.908707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.908677    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:17:03.944709 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944676    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.944884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944721    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.944884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944744    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.944884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944769    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.944884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944810    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.944884 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944861    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944916    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.945145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944944    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.945145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944983    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.945145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.944991    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945145 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945066    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.945452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945173    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.945452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945179    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.945452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945198    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.945452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945330    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.945452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945431    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945479    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945535    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945573    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\") pod \"5de64701-e392-4f8f-a26b-3e499e6b0746\" (UID: \"5de64701-e392-4f8f-a26b-3e499e6b0746\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945619    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945657    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.945791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945711    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\") pod \"7968283a-186f-4fac-8e47-25644285f4b8\" (UID: \"7968283a-186f-4fac-8e47-25644285f4b8\") "
Oct 30 22:17:03.946266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945434    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.946266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945533    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:03.946266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945610    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.946266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945787    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.946541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.945974    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.946541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946365    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:03.946843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946777    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.946843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946801    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.946843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946817    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.946843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946834    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5de64701-e392-4f8f-a26b-3e499e6b0746-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946849    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946861    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946877    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946889    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7968283a-186f-4fac-8e47-25644285f4b8-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946902    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.946915    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:03.947842 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.947816    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:03.948118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.947885    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:03.948183 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.948150    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.948393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.948351    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:03.948678 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.948657    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "kube-api-access-5v7dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:03.948962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.948933    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token" pod "7968283a-186f-4fac-8e47-25644285f4b8" (UID: "7968283a-186f-4fac-8e47-25644285f4b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:03.949045 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.949006    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:03.949795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:03.949776    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl" pod "5de64701-e392-4f8f-a26b-3e499e6b0746" (UID: "5de64701-e392-4f8f-a26b-3e499e6b0746"). InnerVolumeSpecName "kube-api-access-brpgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:04.049292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049257    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049296    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7968283a-186f-4fac-8e47-25644285f4b8-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049309    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049322    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049337    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brpgl\" (UniqueName: \"kubernetes.io/projected/5de64701-e392-4f8f-a26b-3e499e6b0746-kube-api-access-brpgl\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049358    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7968283a-186f-4fac-8e47-25644285f4b8-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049394    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5de64701-e392-4f8f-a26b-3e499e6b0746-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.049585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.049409    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v7dv\" (UniqueName: \"kubernetes.io/projected/7968283a-186f-4fac-8e47-25644285f4b8-kube-api-access-5v7dv\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:04.374527 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.374493    5967 generic.go:356] "Generic (PLEG): container finished" podID="7968283a-186f-4fac-8e47-25644285f4b8" containerID="4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f" exitCode=0
Oct 30 22:17:04.374716 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.374542    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"
Oct 30 22:17:04.374716 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.374574    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" event={"ID":"7968283a-186f-4fac-8e47-25644285f4b8","Type":"ContainerDied","Data":"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"}
Oct 30 22:17:04.374716 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.374648    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95" event={"ID":"7968283a-186f-4fac-8e47-25644285f4b8","Type":"ContainerDied","Data":"f54fc690105dbf873969bbe48a389d7125f46c59fdfd1ad71bec2fde3021ee0c"}
Oct 30 22:17:04.374716 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.374685    5967 scope.go:122] "RemoveContainer" containerID="4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"
Oct 30 22:17:04.376075 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.376048    5967 generic.go:356] "Generic (PLEG): container finished" podID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerID="637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed" exitCode=0
Oct 30 22:17:04.376187 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.376088    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" event={"ID":"5de64701-e392-4f8f-a26b-3e499e6b0746","Type":"ContainerDied","Data":"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"}
Oct 30 22:17:04.376187 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.376141    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp" event={"ID":"5de64701-e392-4f8f-a26b-3e499e6b0746","Type":"ContainerDied","Data":"3d0d8c5c37458f496e7cd0aab0f759baee0f713ab37f94a0a6b9c5d1ad09c245"}
Oct 30 22:17:04.376187 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.376098    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"
Oct 30 22:17:04.385004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.384986    5967 scope.go:122] "RemoveContainer" containerID="4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"
Oct 30 22:17:04.385277 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:17:04.385257    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f\": container with ID starting with 4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f not found: ID does not exist" containerID="4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"
Oct 30 22:17:04.385327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.385286    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f"} err="failed to get container status \"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f\": rpc error: code = NotFound desc = could not find container \"4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f\": container with ID starting with 4e0969cafa8447e7f61269e7d8c2a8a9880ddc586af5ad9bc03cd8d4d7122e7f not found: ID does not exist"
Oct 30 22:17:04.385327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.385303    5967 scope.go:122] "RemoveContainer" containerID="637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"
Oct 30 22:17:04.394475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.394456    5967 scope.go:122] "RemoveContainer" containerID="637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"
Oct 30 22:17:04.394736 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:17:04.394715    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed\": container with ID starting with 637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed not found: ID does not exist" containerID="637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"
Oct 30 22:17:04.394804 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.394742    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed"} err="failed to get container status \"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed\": rpc error: code = NotFound desc = could not find container \"637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed\": container with ID starting with 637d6905cd496dcc84d23b3ff040920d8698e0df7081c6256499232b853938ed not found: ID does not exist"
Oct 30 22:17:04.540678 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.540646    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:17:04.544760 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.544734    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-5h6mp"]
Oct 30 22:17:04.663625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.663539    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:17:04.664734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:04.664702    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-w7z95"]
Oct 30 22:17:05.593432 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:17:05.593385    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:17:06.018970 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:06.018939    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" path="/var/lib/kubelet/pods/5de64701-e392-4f8f-a26b-3e499e6b0746/volumes"
Oct 30 22:17:06.019494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:06.019481    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7968283a-186f-4fac-8e47-25644285f4b8" path="/var/lib/kubelet/pods/7968283a-186f-4fac-8e47-25644285f4b8/volumes"
Oct 30 22:17:35.593602 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:17:35.593558    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:17:36.311063 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:36.311029    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:17:36.311271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:36.311246    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy" containerID="cri-o://1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1" gracePeriod=30
Oct 30 22:17:41.604663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.604633    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:17:41.641935 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.641902    5967 generic.go:356] "Generic (PLEG): container finished" podID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerID="1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1" exitCode=0
Oct 30 22:17:41.642153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.641963    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" event={"ID":"3820681d-2825-4eb8-96e4-f83eb9ac5658","Type":"ContainerDied","Data":"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"}
Oct 30 22:17:41.642153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.641964    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"
Oct 30 22:17:41.642153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.642006    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw" event={"ID":"3820681d-2825-4eb8-96e4-f83eb9ac5658","Type":"ContainerDied","Data":"edd92766190edd127bdc63cb06ee144dfced3859130179c588a7c8f0ae61c98d"}
Oct 30 22:17:41.642153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.642029    5967 scope.go:122] "RemoveContainer" containerID="1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"
Oct 30 22:17:41.652136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.652113    5967 scope.go:122] "RemoveContainer" containerID="1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"
Oct 30 22:17:41.652461 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:17:41.652439    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1\": container with ID starting with 1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1 not found: ID does not exist" containerID="1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"
Oct 30 22:17:41.652540 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.652478    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1"} err="failed to get container status \"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1\": rpc error: code = NotFound desc = could not find container \"1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1\": container with ID starting with 1d26e43a7c95b5e92f5694a0a22dd83caa16e123096de71323dea86ee22448e1 not found: ID does not exist"
Oct 30 22:17:41.705247 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705215    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705262    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705340    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705446    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705619 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705492    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705619 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705525    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.705721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705626    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705660    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705740    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.705825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705765    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.705825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.705771    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\") pod \"3820681d-2825-4eb8-96e4-f83eb9ac5658\" (UID: \"3820681d-2825-4eb8-96e4-f83eb9ac5658\") "
Oct 30 22:17:41.706079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.706061    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:41.706341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.706069    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.706834 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.706237    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.706971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.706707    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.707114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.706990    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.707114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.707016    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3820681d-2825-4eb8-96e4-f83eb9ac5658-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.708246 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.708224    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "kube-api-access-n8qwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.708611 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.708594    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:41.709068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.709045    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.709585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.709566    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy" pod "3820681d-2825-4eb8-96e4-f83eb9ac5658" (UID: "3820681d-2825-4eb8-96e4-f83eb9ac5658"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.808815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808785    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.808815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808809    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.808815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808819    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8qwh\" (UniqueName: \"kubernetes.io/projected/3820681d-2825-4eb8-96e4-f83eb9ac5658-kube-api-access-n8qwh\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.809130 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808829    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.809130 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808837    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3820681d-2825-4eb8-96e4-f83eb9ac5658-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.809130 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:41.808846    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3820681d-2825-4eb8-96e4-f83eb9ac5658-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.068191 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:42.068157    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:17:42.073576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:42.073551    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-h76zw"]
Oct 30 22:17:44.021065 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:17:44.021032    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" path="/var/lib/kubelet/pods/3820681d-2825-4eb8-96e4-f83eb9ac5658/volumes"
Oct 30 22:18:05.592959 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:18:05.592923    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:18:07.628169 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:07.628127    5967 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal" podUID="7ff8f2bfa49239d9e2240c708e676d72" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:35.593829 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:18:35.593789    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:18:46.972926 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:46.972887    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:18:46.973586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:46.973157    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" podUID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" containerName="maas-api" containerID="cri-o://45d298561421ae6537a428f83b41689ca0184ded8739156c677bd58099e4432a" gracePeriod=30
Oct 30 22:18:47.095074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.095048    5967 generic.go:356] "Generic (PLEG): container finished" podID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" containerID="45d298561421ae6537a428f83b41689ca0184ded8739156c677bd58099e4432a" exitCode=0
Oct 30 22:18:47.095171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.095122    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" event={"ID":"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa","Type":"ContainerDied","Data":"45d298561421ae6537a428f83b41689ca0184ded8739156c677bd58099e4432a"}
Oct 30 22:18:47.331906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.331881    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:18:47.411626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.410461    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\") pod \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") "
Oct 30 22:18:47.411626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.410723    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\" (UniqueName: \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\") pod \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") "
Oct 30 22:18:47.411626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.410872    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") pod \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") "
Oct 30 22:18:47.411626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.410939    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\") pod \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\" (UID: \"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa\") "
Oct 30 22:18:47.411995 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.411893    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca" pod "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" (UID: "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:47.438003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.435892    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb" pod "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" (UID: "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa"). InnerVolumeSpecName "kube-api-access-58mqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:47.441902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.441845    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs" pod "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" (UID: "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:47.448399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.444485    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls" pod "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" (UID: "a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:47.521707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.521665    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58mqb\" (UniqueName: \"kubernetes.io/projected/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-kube-api-access-58mqb\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.521968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.521947    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.522110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.522091    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.522223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:47.522210    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:48.102701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:48.102676    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"
Oct 30 22:18:48.103151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:48.102672    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb" event={"ID":"a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa","Type":"ContainerDied","Data":"9913837c5c2d03ff476107c58a302e80546e721d63718c88ecc7d7567f43c897"}
Oct 30 22:18:48.103151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:48.102825    5967 scope.go:122] "RemoveContainer" containerID="45d298561421ae6537a428f83b41689ca0184ded8739156c677bd58099e4432a"
Oct 30 22:18:48.268040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:48.267996    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:18:48.318013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:48.317930    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b355441-65c6dbcc7-x49mb"]
Oct 30 22:18:50.019329 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:50.019294    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" path="/var/lib/kubelet/pods/a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa/volumes"
Oct 30 22:18:58.558078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558044    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:18:58.558670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558654    5967 cpu_manager.go:414] "containerMap: removing container" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy"
Oct 30 22:18:58.558717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558672    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy"
Oct 30 22:18:58.558717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558691    5967 cpu_manager.go:414] "containerMap: removing container" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy"
Oct 30 22:18:58.558717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558697    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy"
Oct 30 22:18:58.558717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558711    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy"
Oct 30 22:18:58.558717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558716    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558729    5967 cpu_manager.go:414] "containerMap: removing container" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558734    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558756    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558761    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558771    5967 cpu_manager.go:414] "containerMap: removing container" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558776    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558786    5967 cpu_manager.go:414] "containerMap: removing container" podUID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" containerName="maas-api"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558791    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" containerName="maas-api"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558799    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy"
Oct 30 22:18:58.558860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558803    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558886    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="784da18a-807b-4a3d-9c61-6d354ac6d000" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558894    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="a75c9db6-ef2a-4e29-a8ca-f9aa8d90e2fa" containerName="maas-api"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558900    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c384f68-f9d4-4cbe-b93b-6994ecaaf208" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558908    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="68e9d472-eba4-4ea1-abb6-847c3c9bdd1c" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558916    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="7968283a-186f-4fac-8e47-25644285f4b8" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558924    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3820681d-2825-4eb8-96e4-f83eb9ac5658" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558930    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b34af5-e750-46a0-b679-24bfd704731d" containerName="istio-proxy"
Oct 30 22:18:58.559143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.558939    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5de64701-e392-4f8f-a26b-3e499e6b0746" containerName="istio-proxy"
Oct 30 22:18:58.563860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.563842    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.612756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.612722    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.612961 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.612878    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w62d\" (UniqueName: \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.612961 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.612955    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.613088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.612994    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.618594 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.618569    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a1024a-serving-cert\""
Oct 30 22:18:58.670901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.670871    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:18:58.714599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.714557    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.714778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.714702    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w62d\" (UniqueName: \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.714778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.714774    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.714904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.714828    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.715110 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:18:58.715076    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-serving-cert: secret "maas-api-e2e-api-a-a1024a-serving-cert" not found
Oct 30 22:18:58.715247 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:18:58.715170    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls podName:f5a57750-0947-41c7-8f72-dd678ec3307d nodeName:}" failed. No retries permitted until 2026-10-30 22:18:59.215148441 +0000 UTC m=+2027.329856773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls") pod "maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" (UID: "f5a57750-0947-41c7-8f72-dd678ec3307d") : secret "maas-api-e2e-api-a-a1024a-serving-cert" not found
Oct 30 22:18:58.715550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.715529    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.717527 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.717505    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:58.778256 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:58.778215    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w62d\" (UniqueName: \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:59.221471 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:59.221439    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:59.223986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:59.223959    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") pod \"maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:59.477295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:59.477214    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:18:59.865337 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:18:59.865301    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:18:59.867318 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:18:59.867290    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a57750_0947_41c7_8f72_dd678ec3307d.slice/crio-eaca16b4056e180fc4ef7516b761af7d1c57a51d5067b32fffb189164e251661 WatchSource:0}: Error finding container eaca16b4056e180fc4ef7516b761af7d1c57a51d5067b32fffb189164e251661: Status 404 returned error can't find the container with id eaca16b4056e180fc4ef7516b761af7d1c57a51d5067b32fffb189164e251661
Oct 30 22:19:00.178463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:19:00.178350    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" event={"ID":"f5a57750-0947-41c7-8f72-dd678ec3307d","Type":"ContainerStarted","Data":"eaca16b4056e180fc4ef7516b761af7d1c57a51d5067b32fffb189164e251661"}
Oct 30 22:19:01.185751 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:19:01.185660    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" event={"ID":"f5a57750-0947-41c7-8f72-dd678ec3307d","Type":"ContainerStarted","Data":"f31666208ae4c07c81da70aedf8ada5763a741adfff92b5ade03d1a15cd2ec48"}
Oct 30 22:19:01.185751 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:19:01.185718    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:19:01.305143 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:19:01.305082    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" podStartSLOduration=2.442019774 podStartE2EDuration="3.30506601s" totalImagesPullingTime="863.046236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:01.303723157 +0000 UTC m=+2029.418431511" watchObservedRunningTime="2026-10-30 22:19:01.30506601 +0000 UTC m=+2029.419774355"
Oct 30 22:19:05.595173 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:19:05.595133    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:19:07.197726 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:19:07.197694    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:19:35.698047 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:19:35.696573    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:20:05.597754 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:20:05.597715    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:20:15.199508 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:15.199477    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:20:15.202815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:15.202794    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:20:35.593107 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:20:35.593070    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:20:52.989637 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:52.989594    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:20:52.990161 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:52.989840    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy" containerID="cri-o://7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631" gracePeriod=30
Oct 30 22:20:58.277421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.277393    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.398960    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399025    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399073    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399107    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399199    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399300    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399397    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399480    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.424398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.399522    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\") pod \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\" (UID: \"44c7b1fc-da95-4416-bdb2-a5a64596a1c9\") "
Oct 30 22:20:58.426525 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.426477    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:20:58.426971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.426539    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:20:58.427157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.427128    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:20:58.445465 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.427389    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:20:58.445465 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.430572    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:58.468510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.468303    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:58.468510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.468458    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:20:58.468901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.468860    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "kube-api-access-wbjmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:58.474473 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.470032    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo" pod "44c7b1fc-da95-4416-bdb2-a5a64596a1c9" (UID: "44c7b1fc-da95-4416-bdb2-a5a64596a1c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:20:58.501583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501542    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501578    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbjmv\" (UniqueName: \"kubernetes.io/projected/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-kube-api-access-wbjmv\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501595    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501610    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501623    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501636    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501650    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501663    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:58.501837 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:58.501677    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44c7b1fc-da95-4416-bdb2-a5a64596a1c9-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:59.110578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.110538    5967 generic.go:356] "Generic (PLEG): container finished" podID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerID="7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631" exitCode=0
Oct 30 22:20:59.110578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.110584    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"
Oct 30 22:20:59.110789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.110620    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" event={"ID":"44c7b1fc-da95-4416-bdb2-a5a64596a1c9","Type":"ContainerDied","Data":"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"}
Oct 30 22:20:59.110789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.110694    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx" event={"ID":"44c7b1fc-da95-4416-bdb2-a5a64596a1c9","Type":"ContainerDied","Data":"c79ad4bc794a05bcffe66f701cb70309fabc9b358fc452569d82287da6805247"}
Oct 30 22:20:59.110789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.110724    5967 scope.go:122] "RemoveContainer" containerID="7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"
Oct 30 22:20:59.126146 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.126125    5967 scope.go:122] "RemoveContainer" containerID="7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"
Oct 30 22:20:59.126484 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:20:59.126467    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631\": container with ID starting with 7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631 not found: ID does not exist" containerID="7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"
Oct 30 22:20:59.126550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.126493    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631"} err="failed to get container status \"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631\": rpc error: code = NotFound desc = could not find container \"7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631\": container with ID starting with 7f4bcec5d3d6f52a8fb8ea9315ff551678bfc7a1a5cfb4c1ee057dc46709c631 not found: ID does not exist"
Oct 30 22:20:59.329781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.329696    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:20:59.378623 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:20:59.378591    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-rpshx"]
Oct 30 22:21:00.019470 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:00.019438    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" path="/var/lib/kubelet/pods/44c7b1fc-da95-4416-bdb2-a5a64596a1c9/volumes"
Oct 30 22:21:03.218616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.218581    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:21:03.219627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.219604    5967 cpu_manager.go:414] "containerMap: removing container" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy"
Oct 30 22:21:03.219771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.219648    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy"
Oct 30 22:21:03.219877 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.219862    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="44c7b1fc-da95-4416-bdb2-a5a64596a1c9" containerName="istio-proxy"
Oct 30 22:21:03.225652 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.225628    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.302393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.283669    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310535    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310620    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310724    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310754    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310826    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310865    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk64r\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310916    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.310948    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.323400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.291412    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-67657a-openshift-default-dockercfg-kbbx8\""
Oct 30 22:21:03.413326 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.413265    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:21:03.421617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.421583    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.421928 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.421907    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.422077 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.422061    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.422255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.422238    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.422403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.422364    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.422573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.422556    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.422702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.422687    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk64r\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.430151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.430117    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.448512 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.448475    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.462596 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.429913    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.462938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.430215    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.463134 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.423813    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.463282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.430929    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.463438 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.431153    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.463552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.425688    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.463682 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.449522    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.492341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.492267    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.492341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.492320    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk64r\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\") pod \"e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") " pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.559158 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.559123    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:03.994880 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:03.994857    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:21:03.998101 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:21:03.998073    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b10444_8016_498c_9431_6048a2fc812b.slice/crio-f8907ba0aaa9eeeda93eb48f29f6922fb7f5eb41ab69d49955fac00b3365a136 WatchSource:0}: Error finding container f8907ba0aaa9eeeda93eb48f29f6922fb7f5eb41ab69d49955fac00b3365a136: Status 404 returned error can't find the container with id f8907ba0aaa9eeeda93eb48f29f6922fb7f5eb41ab69d49955fac00b3365a136
Oct 30 22:21:04.001090 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.001056    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:21:04.001174 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.001128    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:21:04.001213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.001178    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:21:04.176627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.176592    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerStarted","Data":"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"}
Oct 30 22:21:04.176886 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.176870    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerStarted","Data":"f8907ba0aaa9eeeda93eb48f29f6922fb7f5eb41ab69d49955fac00b3365a136"}
Oct 30 22:21:04.298730 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.298611    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podStartSLOduration=1.29859406 podStartE2EDuration="1.29859406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:04.298449501 +0000 UTC m=+2152.413157853" watchObservedRunningTime="2026-10-30 22:21:04.29859406 +0000 UTC m=+2152.413302407"
Oct 30 22:21:04.560064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:04.559980    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:05.566047 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:05.566018    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:05.595029 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:05.594988    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:21:06.189833 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:06.189798    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:06.190813 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:06.190796    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:21:07.009147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:07.009115    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:21:07.009689 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:07.009322    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" containerID="cri-o://3539a61004bb1e4fc50780adb5e4306a86663867169443fb4c2665c271c13af3" gracePeriod=30
Oct 30 22:21:07.776973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:07.776932    5967 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:21:07.777144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:07.777005    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:21:12.231208 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.231169    5967 generic.go:356] "Generic (PLEG): container finished" podID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerID="3539a61004bb1e4fc50780adb5e4306a86663867169443fb4c2665c271c13af3" exitCode=0
Oct 30 22:21:12.231703 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.231239    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" event={"ID":"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd","Type":"ContainerDied","Data":"3539a61004bb1e4fc50780adb5e4306a86663867169443fb4c2665c271c13af3"}
Oct 30 22:21:12.294985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.294904    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:21:12.350723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350690    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.350932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350749    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.350932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350785    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.350932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350812    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.350932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350898    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.351142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350939    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.351142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350962    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:12.351142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.350982    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.351142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351084    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:12.351142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351120    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.351404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351228    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\") pod \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\" (UID: \"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd\") "
Oct 30 22:21:12.351404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351273    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:12.351501 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351404    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:12.351821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351797    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.351821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351824    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.352037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351835    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.352037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351849    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.352037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.351803    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:12.353325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.353286    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:21:12.353325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.353304    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:12.353548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.353443    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:12.353661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.353641    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk" pod "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" (UID: "64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd"). InnerVolumeSpecName "kube-api-access-sj5tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:12.453705 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.453675    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.453705 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.453699    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.453705 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.453709    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.453939 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.453719    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj5tk\" (UniqueName: \"kubernetes.io/projected/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-kube-api-access-sj5tk\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:12.453939 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:12.453729    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:13.146870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:13.146836    5967 scope.go:122] "RemoveContainer" containerID="3539a61004bb1e4fc50780adb5e4306a86663867169443fb4c2665c271c13af3"
Oct 30 22:21:13.236651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:13.236616    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"
Oct 30 22:21:13.236651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:13.236626    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596" event={"ID":"64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd","Type":"ContainerDied","Data":"b2aa932ac8c14a2a02627d9ff028e14b799c04ffe60bc73a14db3cd6754b6594"}
Oct 30 22:21:13.469637 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:13.469605    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:21:13.475668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:13.475642    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-qx596"]
Oct 30 22:21:14.019774 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:14.019741    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" path="/var/lib/kubelet/pods/64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd/volumes"
Oct 30 22:21:15.552659 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:15.552625    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:21:15.553057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:15.552877    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy" containerID="cri-o://0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c" gracePeriod=30
Oct 30 22:21:20.832075 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:20.832006    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:21:21.000404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.000273    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.000404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.000359    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.000673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.000440    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.000673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.000562    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.005406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.001770    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:21.005406 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.002054    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.010268    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.020479    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.020576    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.020627    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.020676    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.020724    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\") pod \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\" (UID: \"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70\") "
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.021508    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.021532    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.025394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.021546    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.056395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.029326    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:21.056395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.034507    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:21.073504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.060040    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:21:21.073504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.066839    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:21.073504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.067185    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "kube-api-access-269kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:21.077424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.077151    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token" pod "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" (UID: "5c7f84f6-4a82-4cf2-b195-6c53dbae0f70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124584    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124619    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-269kc\" (UniqueName: \"kubernetes.io/projected/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-kube-api-access-269kc\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124634    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124648    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124661    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.126292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.124672    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:21.289113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.289075    5967 generic.go:356] "Generic (PLEG): container finished" podID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerID="0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c" exitCode=0
Oct 30 22:21:21.289295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.289125    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"
Oct 30 22:21:21.289295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.289160    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" event={"ID":"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70","Type":"ContainerDied","Data":"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"}
Oct 30 22:21:21.289295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.289221    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p" event={"ID":"5c7f84f6-4a82-4cf2-b195-6c53dbae0f70","Type":"ContainerDied","Data":"551bf30e56573267d1df188e065e74487faee0a681622735cd1d522899bfc2d7"}
Oct 30 22:21:21.289295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.289245    5967 scope.go:122] "RemoveContainer" containerID="0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"
Oct 30 22:21:21.300000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.299983    5967 scope.go:122] "RemoveContainer" containerID="0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"
Oct 30 22:21:21.300281 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:21.300260    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c\": container with ID starting with 0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c not found: ID does not exist" containerID="0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"
Oct 30 22:21:21.300352 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.300289    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c"} err="failed to get container status \"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c\": rpc error: code = NotFound desc = could not find container \"0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c\": container with ID starting with 0f70cb3bcf4a4367f9de9f4cb72f3181fd0a871ae813e27bb472a8e4c39fb00c not found: ID does not exist"
Oct 30 22:21:21.455190 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.455089    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:21:21.503822 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:21.503790    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-g2w2p"]
Oct 30 22:21:22.020772 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:22.020730    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" path="/var/lib/kubelet/pods/5c7f84f6-4a82-4cf2-b195-6c53dbae0f70/volumes"
Oct 30 22:21:22.390988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:22.390903    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:21:22.391171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:22.391133    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" containerID="cri-o://2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49" gracePeriod=30
Oct 30 22:21:25.237707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:25.237671    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:21:25.238125 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:25.237738    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:21:27.651725 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.651698    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:21:27.729089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729057    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729093    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729150    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729293    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729342    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729405    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729455    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729466    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:27.729620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729509    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:27.729620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729550    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729609    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\") pod \"d2d15129-80fb-4970-8a5c-c3410f562bea\" (UID: \"d2d15129-80fb-4970-8a5c-c3410f562bea\") "
Oct 30 22:21:27.729812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729608    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:27.729860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729676    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:27.729860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.729834    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:27.730484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.730462    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.730576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.730489    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.730576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.730503    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2d15129-80fb-4970-8a5c-c3410f562bea-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.730576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.730517    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.730576 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.730532    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.731863 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.731838    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:27.731984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.731874    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:27.732071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.732051    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:21:27.732129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.732079    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz" pod "d2d15129-80fb-4970-8a5c-c3410f562bea" (UID: "d2d15129-80fb-4970-8a5c-c3410f562bea"). InnerVolumeSpecName "kube-api-access-9dsbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:27.831526 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.831492    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.831526 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.831523    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dsbz\" (UniqueName: \"kubernetes.io/projected/d2d15129-80fb-4970-8a5c-c3410f562bea-kube-api-access-9dsbz\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.831715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.831536    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:27.831715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:27.831548    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2d15129-80fb-4970-8a5c-c3410f562bea-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:28.333734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.333653    5967 generic.go:356] "Generic (PLEG): container finished" podID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerID="2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49" exitCode=0
Oct 30 22:21:28.333734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.333705    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"
Oct 30 22:21:28.333933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.333731    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" event={"ID":"d2d15129-80fb-4970-8a5c-c3410f562bea","Type":"ContainerDied","Data":"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"}
Oct 30 22:21:28.333933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.333783    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk" event={"ID":"d2d15129-80fb-4970-8a5c-c3410f562bea","Type":"ContainerDied","Data":"b98b8afea603586ab0ee3f6257efd39978c8534cfecdff8cc25e2c42b6e84cf6"}
Oct 30 22:21:28.333933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.333804    5967 scope.go:122] "RemoveContainer" containerID="2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"
Oct 30 22:21:28.343421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.343403    5967 scope.go:122] "RemoveContainer" containerID="2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"
Oct 30 22:21:28.343705 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:28.343686    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49\": container with ID starting with 2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49 not found: ID does not exist" containerID="2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"
Oct 30 22:21:28.343774 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.343717    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49"} err="failed to get container status \"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49\": rpc error: code = NotFound desc = could not find container \"2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49\": container with ID starting with 2c0de7d41aa75fed7a13dc0b92cc62645dc5540b3ff8fdffe37ef805efe24d49 not found: ID does not exist"
Oct 30 22:21:28.501645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.501615    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:21:28.506549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.506522    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-j9mjk"]
Oct 30 22:21:28.778645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.778616    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:21:28.779213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779198    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy"
Oct 30 22:21:28.779252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779215    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy"
Oct 30 22:21:28.779252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779231    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy"
Oct 30 22:21:28.779252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779236    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy"
Oct 30 22:21:28.779349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779257    5967 cpu_manager.go:414] "containerMap: removing container" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy"
Oct 30 22:21:28.779349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779262    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy"
Oct 30 22:21:28.779419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779394    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="64de9a53-4eb6-49fa-9d53-2e0da8b9fbbd" containerName="istio-proxy"
Oct 30 22:21:28.779419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779409    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c7f84f6-4a82-4cf2-b195-6c53dbae0f70" containerName="istio-proxy"
Oct 30 22:21:28.779419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.779417    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" containerName="istio-proxy"
Oct 30 22:21:28.783666 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.783651    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:28.836262 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.836226    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a78655-serving-cert\""
Oct 30 22:21:28.844090 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.844056    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:21:28.946759 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.946724    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw4x\" (UniqueName: \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:28.946921 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.946785    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:28.946978 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.946953    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:28.947039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:28.947024    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.065484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.064453    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.065484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.064704    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw4x\" (UniqueName: \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.065484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.064755    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.065484 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.064846    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.066540 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:29.066509    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-serving-cert: secret "maas-api-e2e-inf-a-a78655-serving-cert" not found
Oct 30 22:21:29.066679 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:29.066605    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls podName:9db785d6-e248-43c8-90d7-fae273e9f29f nodeName:}" failed. No retries permitted until 2026-10-30 22:21:29.566582677 +0000 UTC m=+2177.681291020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls") pod "maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" (UID: "9db785d6-e248-43c8-90d7-fae273e9f29f") : secret "maas-api-e2e-inf-a-a78655-serving-cert" not found
Oct 30 22:21:29.067214 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.067188    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.075154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.074125    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.128218 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.128182    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw4x\" (UniqueName: \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.571740 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.571708    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.574280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.574259    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:29.697788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:29.697745    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:30.019713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:30.019679    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2d15129-80fb-4970-8a5c-c3410f562bea" path="/var/lib/kubelet/pods/d2d15129-80fb-4970-8a5c-c3410f562bea/volumes"
Oct 30 22:21:30.077711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:30.077690    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:21:30.080328 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:21:30.080299    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db785d6_e248_43c8_90d7_fae273e9f29f.slice/crio-b9e76649d41dc1b9f96de96e18692dda1650f1534720df821291f294572507e9 WatchSource:0}: Error finding container b9e76649d41dc1b9f96de96e18692dda1650f1534720df821291f294572507e9: Status 404 returned error can't find the container with id b9e76649d41dc1b9f96de96e18692dda1650f1534720df821291f294572507e9
Oct 30 22:21:30.081693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:30.081674    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:21:30.349329 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:30.349241    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" event={"ID":"9db785d6-e248-43c8-90d7-fae273e9f29f","Type":"ContainerStarted","Data":"b9e76649d41dc1b9f96de96e18692dda1650f1534720df821291f294572507e9"}
Oct 30 22:21:31.357403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:31.357322    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" event={"ID":"9db785d6-e248-43c8-90d7-fae273e9f29f","Type":"ContainerStarted","Data":"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"}
Oct 30 22:21:31.357839 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:31.357418    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:31.476600 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:31.476546    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" podStartSLOduration=2.644794915 podStartE2EDuration="3.476531917s" totalImagesPullingTime="831.737002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:31.474441683 +0000 UTC m=+2179.589150038" watchObservedRunningTime="2026-10-30 22:21:31.476531917 +0000 UTC m=+2179.591240269"
Oct 30 22:21:35.593278 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:35.593243    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:21:37.369278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:37.369247    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:21:54.800768 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.800728    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:21:54.806987 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.805996    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.813805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.813770    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.813967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.813858    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-449rl\" (UniqueName: \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.814085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.814060    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.814199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.814174    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.890266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.890173    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w0-0f3344-serving-cert\""
Oct 30 22:21:54.912628 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.912594    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:21:54.926569 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.926536    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.927039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.927015    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.927310 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.927290    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.927478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.927462    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-449rl\" (UniqueName: \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.928105 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:54.926885    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-serving-cert: secret "maas-api-e2e-shared-b-w0-0f3344-serving-cert" not found
Oct 30 22:21:54.928294 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:21:54.928283    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls podName:507da48b-7a51-4c41-b5d9-5b97ca565ad6 nodeName:}" failed. No retries permitted until 2026-10-30 22:21:55.428258234 +0000 UTC m=+2203.542966566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls") pod "maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" (UID: "507da48b-7a51-4c41-b5d9-5b97ca565ad6") : secret "maas-api-e2e-shared-b-w0-0f3344-serving-cert" not found
Oct 30 22:21:54.951464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.934955    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:54.951464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:54.936896    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:55.008104 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:55.006683    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-449rl\" (UniqueName: \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:55.436182 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:55.436141    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:55.438856 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:55.438826    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:55.727552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:55.727520    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:56.107724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:56.107697    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:21:56.109741 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:21:56.109708    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507da48b_7a51_4c41_b5d9_5b97ca565ad6.slice/crio-69e0b452818005530cc6c3ff5e3359dd4c1de75a1c34a2a06d03364460d35b24 WatchSource:0}: Error finding container 69e0b452818005530cc6c3ff5e3359dd4c1de75a1c34a2a06d03364460d35b24: Status 404 returned error can't find the container with id 69e0b452818005530cc6c3ff5e3359dd4c1de75a1c34a2a06d03364460d35b24
Oct 30 22:21:56.555089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:56.555052    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" event={"ID":"507da48b-7a51-4c41-b5d9-5b97ca565ad6","Type":"ContainerStarted","Data":"69e0b452818005530cc6c3ff5e3359dd4c1de75a1c34a2a06d03364460d35b24"}
Oct 30 22:21:57.562778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:57.562741    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" event={"ID":"507da48b-7a51-4c41-b5d9-5b97ca565ad6","Type":"ContainerStarted","Data":"899c7a7ac791a33b0ff5bf8b3af2c39fbe396b5d1dc679feb33bb1f192904e24"}
Oct 30 22:21:57.563260 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:57.562808    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:21:57.684039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:21:57.683977    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" podStartSLOduration=2.836702834 podStartE2EDuration="3.683964116s" totalImagesPullingTime="847.261282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:57.681199371 +0000 UTC m=+2205.795907720" watchObservedRunningTime="2026-10-30 22:21:57.683964116 +0000 UTC m=+2205.798672467"
Oct 30 22:22:00.927412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:00.927363    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:22:00.927882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:00.927637    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" containerID="cri-o://c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587" gracePeriod=30
Oct 30 22:22:02.731949 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:02.731909    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:22:02.732420 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:02.731965    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:22:03.573485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:03.573456    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:22:05.593488 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:05.593453    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:22:06.206985 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.206908    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:22:06.279603 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279563    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.279807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279624    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.279807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279687    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.279807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279729    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.279807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279799    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.280032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279841    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.280032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279889    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.280032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.279951    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:06.280032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280021    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.280255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280048    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\") pod \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\" (UID: \"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede\") "
Oct 30 22:22:06.280307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280273    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:06.280307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280286    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:06.280307 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280201    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:06.280502 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280485    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:06.280678 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280662    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.280742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280682    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.280742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280691    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.280742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280703    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.280742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.280718    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.282178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.282148    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:06.282178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.282160    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:06.282348 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.282233    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "kube-api-access-p45f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:06.282515 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.282497    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo" pod "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" (UID: "6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:06.382497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.382440    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p45f6\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-kube-api-access-p45f6\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.382497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.382498    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.382497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.382513    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.382914 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.382526    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:06.638668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.638636    5967 generic.go:356] "Generic (PLEG): container finished" podID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerID="c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587" exitCode=0
Oct 30 22:22:06.639163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.638689    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"
Oct 30 22:22:06.639163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.638718    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" event={"ID":"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede","Type":"ContainerDied","Data":"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"}
Oct 30 22:22:06.639163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.638773    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz" event={"ID":"6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede","Type":"ContainerDied","Data":"305b5d60ec111ba857ab8c1c2408a42db4fe9090b92c1be2c0fa6e2b53ab4ba4"}
Oct 30 22:22:06.639163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.638794    5967 scope.go:122] "RemoveContainer" containerID="c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"
Oct 30 22:22:06.649477 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.649462    5967 scope.go:122] "RemoveContainer" containerID="c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"
Oct 30 22:22:06.649740 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:06.649719    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587\": container with ID starting with c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587 not found: ID does not exist" containerID="c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"
Oct 30 22:22:06.649809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.649752    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587"} err="failed to get container status \"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587\": rpc error: code = NotFound desc = could not find container \"c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587\": container with ID starting with c391647b94cc1678ae5c703110703de473ec64592476398a5782dfa7ab10b587 not found: ID does not exist"
Oct 30 22:22:06.839811 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.839773    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:22:06.887154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:06.887118    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-fmphz"]
Oct 30 22:22:08.021239 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:08.021202    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" path="/var/lib/kubelet/pods/6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede/volumes"
Oct 30 22:22:23.521717 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:23.521683    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:22:23.522134 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:23.521888    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" containerID="cri-o://f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd" gracePeriod=30
Oct 30 22:22:24.686060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:24.684571    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:22:24.686060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:24.684920    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:22:28.798876 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.798807    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:22:28.799276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.799115    5967 generic.go:356] "Generic (PLEG): container finished" podID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerID="f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd" exitCode=0
Oct 30 22:22:28.799276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.799178    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" event={"ID":"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd","Type":"ContainerDied","Data":"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"}
Oct 30 22:22:28.799276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.799235    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw" event={"ID":"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd","Type":"ContainerDied","Data":"81809b4982e69d001fee4bd382fbf544ff484539d7e4f8ba8b66240a11c8aaa3"}
Oct 30 22:22:28.799276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.799258    5967 scope.go:122] "RemoveContainer" containerID="f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"
Oct 30 22:22:28.808836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.808820    5967 scope.go:122] "RemoveContainer" containerID="f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"
Oct 30 22:22:28.809099 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:28.809076    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd\": container with ID starting with f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd not found: ID does not exist" containerID="f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"
Oct 30 22:22:28.809172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.809106    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd"} err="failed to get container status \"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd\": rpc error: code = NotFound desc = could not find container \"f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd\": container with ID starting with f3589a374bfb19aa0f0b95de108a450ed648837abdb80f3ae8c52ea8cb994ecd not found: ID does not exist"
Oct 30 22:22:28.891317 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891287    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891341    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891359    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891431    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891527    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.891679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891535    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891638    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.891679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891650    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891899 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891805    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891899 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891856    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.891899 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891876    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.891899 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891892    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\") pod \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\" (UID: \"22b6b291-7c31-4779-afe1-ad4a6a7e1bdd\") "
Oct 30 22:22:28.892111 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.891909    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:28.892111 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892050    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.892521 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892501    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.892689 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892675    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.892791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892771    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.892932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892793    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.892932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.892809    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.894283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.894246    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "kube-api-access-8skpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:28.894283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.894270    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:28.894534 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.894327    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:28.894534 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.894337    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy" pod "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" (UID: "22b6b291-7c31-4779-afe1-ad4a6a7e1bdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.994194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.994158    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.994194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.994191    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.994194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.994201    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.994461 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:28.994211    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8skpx\" (UniqueName: \"kubernetes.io/projected/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd-kube-api-access-8skpx\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:29.805931 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:29.805901    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"
Oct 30 22:22:30.032979 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:30.032942    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:22:30.081760 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:30.081677    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4xhnw"]
Oct 30 22:22:32.020427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:32.020392    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" path="/var/lib/kubelet/pods/22b6b291-7c31-4779-afe1-ad4a6a7e1bdd/volumes"
Oct 30 22:22:35.592782 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:35.592744    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:22:50.188642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.188605    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:22:50.189384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189328    5967 cpu_manager.go:414] "containerMap: removing container" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy"
Oct 30 22:22:50.189384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189359    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy"
Oct 30 22:22:50.189550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189431    5967 cpu_manager.go:414] "containerMap: removing container" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy"
Oct 30 22:22:50.189550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189442    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy"
Oct 30 22:22:50.189660 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189581    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="22b6b291-7c31-4779-afe1-ad4a6a7e1bdd" containerName="istio-proxy"
Oct 30 22:22:50.189660 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.189604    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cecd42f-0a32-4cf9-a9de-dbfbfdbd0ede" containerName="istio-proxy"
Oct 30 22:22:50.193340 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.193318    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.245857 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.245827    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e3324355-serving-cert\""
Oct 30 22:22:50.262017 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.261974    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.262195 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.262129    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79sxm\" (UniqueName: \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.262286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.262262    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.262423 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.262364    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.298170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.298142    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:22:50.363578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.363533    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79sxm\" (UniqueName: \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.363797 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.363645    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.363797 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.363698    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.363931 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.363869    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.364017 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:50.363996    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-serving-cert: secret "maas-api-e2e-mt-e3324355-serving-cert" not found
Oct 30 22:22:50.364087 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:22:50.364075    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls podName:5aed3651-9994-43c9-9465-18ab7cde4a56 nodeName:}" failed. No retries permitted until 2026-10-30 22:22:50.864058385 +0000 UTC m=+2258.978766714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls") pod "maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" (UID: "5aed3651-9994-43c9-9465-18ab7cde4a56") : secret "maas-api-e2e-mt-e3324355-serving-cert" not found
Oct 30 22:22:50.364548 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.364520    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.366386 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.366346    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.435061 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.434988    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79sxm\" (UniqueName: \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.874395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.873553    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:50.884072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:50.884042    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") pod \"maas-api-e2e-mt-e3324355-579786b4fb-9nmvq\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:51.108341 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:51.108309    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:51.496622 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:51.496592    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:22:51.498729 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:22:51.498703    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aed3651_9994_43c9_9465_18ab7cde4a56.slice/crio-c3c89a378cad2daf0963360b3a79c8fde566bc32feabd7d691ca02f62a62cfcc WatchSource:0}: Error finding container c3c89a378cad2daf0963360b3a79c8fde566bc32feabd7d691ca02f62a62cfcc: Status 404 returned error can't find the container with id c3c89a378cad2daf0963360b3a79c8fde566bc32feabd7d691ca02f62a62cfcc
Oct 30 22:22:51.955047 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:51.954961    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerStarted","Data":"c3c89a378cad2daf0963360b3a79c8fde566bc32feabd7d691ca02f62a62cfcc"}
Oct 30 22:22:52.962303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:52.962266    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerStarted","Data":"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"}
Oct 30 22:22:52.962701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:52.962325    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:22:53.081024 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:53.080971    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" podStartSLOduration=2.318959758 podStartE2EDuration="3.080956854s" totalImagesPullingTime="761.997096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:22:53.080115187 +0000 UTC m=+2261.194823539" watchObservedRunningTime="2026-10-30 22:22:53.080956854 +0000 UTC m=+2261.195665204"
Oct 30 22:22:58.972440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:22:58.972396    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.91:8443/health\": dial tcp 10.134.0.91:8443: connect: connection refused"
Oct 30 22:23:03.026662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:03.026629    5967 generic.go:356] "Generic (PLEG): container finished" podID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerID="bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a" exitCode=1
Oct 30 22:23:03.027117 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:03.026705    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerDied","Data":"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"}
Oct 30 22:23:03.027117 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:03.027110    5967 scope.go:122] "RemoveContainer" containerID="bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"
Oct 30 22:23:04.034605 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:04.034568    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerStarted","Data":"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"}
Oct 30 22:23:04.035013 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:04.034782    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:23:05.593406 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:23:05.593330    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:23:10.049093 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:10.049064    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:23:17.354222 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.354188    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:23:17.354787 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.354474    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerName="maas-api" containerID="cri-o://ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d" gracePeriod=30
Oct 30 22:23:17.364491 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.364459    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.89:8443/health\": dial tcp 10.134.0.89:8443: connect: connection refused"
Oct 30 22:23:17.690311 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.690279    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:23:17.866995 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.866949    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\" (UniqueName: \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\") pod \"9db785d6-e248-43c8-90d7-fae273e9f29f\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") "
Oct 30 22:23:17.867201 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.867059    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\") pod \"9db785d6-e248-43c8-90d7-fae273e9f29f\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") "
Oct 30 22:23:17.867201 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.867087    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") pod \"9db785d6-e248-43c8-90d7-fae273e9f29f\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") "
Oct 30 22:23:17.867201 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.867118    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\") pod \"9db785d6-e248-43c8-90d7-fae273e9f29f\" (UID: \"9db785d6-e248-43c8-90d7-fae273e9f29f\") "
Oct 30 22:23:17.868086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.868056    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca" pod "9db785d6-e248-43c8-90d7-fae273e9f29f" (UID: "9db785d6-e248-43c8-90d7-fae273e9f29f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:17.873456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.873340    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls" pod "9db785d6-e248-43c8-90d7-fae273e9f29f" (UID: "9db785d6-e248-43c8-90d7-fae273e9f29f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:17.873456 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.873421    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x" pod "9db785d6-e248-43c8-90d7-fae273e9f29f" (UID: "9db785d6-e248-43c8-90d7-fae273e9f29f"). InnerVolumeSpecName "kube-api-access-jjw4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:17.873803 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.873781    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs" pod "9db785d6-e248-43c8-90d7-fae273e9f29f" (UID: "9db785d6-e248-43c8-90d7-fae273e9f29f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:17.969194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.969160    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:17.969194 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.969193    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9db785d6-e248-43c8-90d7-fae273e9f29f-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:17.969453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.969208    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db785d6-e248-43c8-90d7-fae273e9f29f-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:17.969453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:17.969225    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjw4x\" (UniqueName: \"kubernetes.io/projected/9db785d6-e248-43c8-90d7-fae273e9f29f-kube-api-access-jjw4x\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:18.135988 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.135949    5967 generic.go:356] "Generic (PLEG): container finished" podID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerID="ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d" exitCode=0
Oct 30 22:23:18.136159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.135995    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"
Oct 30 22:23:18.136159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.136034    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" event={"ID":"9db785d6-e248-43c8-90d7-fae273e9f29f","Type":"ContainerDied","Data":"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"}
Oct 30 22:23:18.136159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.136086    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz" event={"ID":"9db785d6-e248-43c8-90d7-fae273e9f29f","Type":"ContainerDied","Data":"b9e76649d41dc1b9f96de96e18692dda1650f1534720df821291f294572507e9"}
Oct 30 22:23:18.136159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.136108    5967 scope.go:122] "RemoveContainer" containerID="ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"
Oct 30 22:23:18.146036 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.146016    5967 scope.go:122] "RemoveContainer" containerID="ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"
Oct 30 22:23:18.146303 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:23:18.146281    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d\": container with ID starting with ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d not found: ID does not exist" containerID="ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"
Oct 30 22:23:18.146350 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.146312    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d"} err="failed to get container status \"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d\": rpc error: code = NotFound desc = could not find container \"ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d\": container with ID starting with ec95d30ba06849c7aa5416c50c9be4a102124037fa59ec6f10bc1b9949511f9d not found: ID does not exist"
Oct 30 22:23:18.300612 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.300542    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:23:18.350413 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:18.350385    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a78655-678d84bb6d-kldfz"]
Oct 30 22:23:20.019549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:20.019512    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" path="/var/lib/kubelet/pods/9db785d6-e248-43c8-90d7-fae273e9f29f/volumes"
Oct 30 22:23:31.430136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.430100    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:23:31.430675 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.430660    5967 cpu_manager.go:414] "containerMap: removing container" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerName="maas-api"
Oct 30 22:23:31.430719 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.430677    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerName="maas-api"
Oct 30 22:23:31.430816 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.430807    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="9db785d6-e248-43c8-90d7-fae273e9f29f" containerName="maas-api"
Oct 30 22:23:31.435661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.435646    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.488699 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.488669    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-25237a-serving-cert\""
Oct 30 22:23:31.541190 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.541159    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:23:31.550447 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.550426    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.550586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.550458    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.550586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.550567    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.550691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.550610    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzrd\" (UniqueName: \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.651790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.651751    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.651790 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.651795    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.652065 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.651847    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.652065 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.651878    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzrd\" (UniqueName: \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.652065 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:23:31.651997    5967 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-serving-cert: secret "maas-api-e2e-api-a-25237a-serving-cert" not found
Oct 30 22:23:31.652219 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:23:31.652094    5967 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls podName:27027312-9922-439f-926d-14ca281f4ab5 nodeName:}" failed. No retries permitted until 2026-10-30 22:23:32.152070205 +0000 UTC m=+2300.266778551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls") pod "maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" (UID: "27027312-9922-439f-926d-14ca281f4ab5") : secret "maas-api-e2e-api-a-25237a-serving-cert" not found
Oct 30 22:23:31.652585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.652566    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.654347 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.654328    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:31.714028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:31.713996    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzrd\" (UniqueName: \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:32.159035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:32.158958    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:32.161472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:32.161447    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") pod \"maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:32.349726 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:32.349678    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:32.735598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:32.735555    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:23:32.738147 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:23:32.738089    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27027312_9922_439f_926d_14ca281f4ab5.slice/crio-2d3b63a5a03710a1382fe3f9a4e6aab7778271825dd3bd7987c9de7bd9f7780b WatchSource:0}: Error finding container 2d3b63a5a03710a1382fe3f9a4e6aab7778271825dd3bd7987c9de7bd9f7780b: Status 404 returned error can't find the container with id 2d3b63a5a03710a1382fe3f9a4e6aab7778271825dd3bd7987c9de7bd9f7780b
Oct 30 22:23:33.230597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:33.230557    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" event={"ID":"27027312-9922-439f-926d-14ca281f4ab5","Type":"ContainerStarted","Data":"2d3b63a5a03710a1382fe3f9a4e6aab7778271825dd3bd7987c9de7bd9f7780b"}
Oct 30 22:23:34.238067 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:34.238033    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" event={"ID":"27027312-9922-439f-926d-14ca281f4ab5","Type":"ContainerStarted","Data":"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"}
Oct 30 22:23:34.238507 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:34.238169    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:23:34.358647 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:34.358595    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" podStartSLOduration=2.550161234 podStartE2EDuration="3.358580403s" totalImagesPullingTime="808.419169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:34.355830546 +0000 UTC m=+2302.470538922" watchObservedRunningTime="2026-10-30 22:23:34.358580403 +0000 UTC m=+2302.473288763"
Oct 30 22:23:35.595537 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:23:35.595491    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:23:40.249249 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:23:40.249221    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:24:05.593562 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:05.593519    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:24:15.545447 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.545417    5967 generic.go:356] "Generic (PLEG): container finished" podID="c4b10444-8016-498c-9431-6048a2fc812b" containerID="ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4" exitCode=0
Oct 30 22:24:15.545859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.545483    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerDied","Data":"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"}
Oct 30 22:24:15.545946 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.545927    5967 scope.go:122] "RemoveContainer" containerID="ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"
Oct 30 22:24:15.547926 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.547885    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:24:15.548041 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.547972    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:24:15.548041 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.548019    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:24:15.564572 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.564541    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:24:15.564795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.564768    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" podUID="85b278f9-7ee1-48fa-856d-0972ed08cefe" containerName="maas-api" containerID="cri-o://b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17" gracePeriod=30
Oct 30 22:24:15.920418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:15.913726    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:24:16.046503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.043317    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") pod \"85b278f9-7ee1-48fa-856d-0972ed08cefe\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") "
Oct 30 22:24:16.046503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.043521    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\" (UniqueName: \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\") pod \"85b278f9-7ee1-48fa-856d-0972ed08cefe\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") "
Oct 30 22:24:16.046503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.043677    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\") pod \"85b278f9-7ee1-48fa-856d-0972ed08cefe\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") "
Oct 30 22:24:16.046503 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.043742    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\") pod \"85b278f9-7ee1-48fa-856d-0972ed08cefe\" (UID: \"85b278f9-7ee1-48fa-856d-0972ed08cefe\") "
Oct 30 22:24:16.049037 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.048692    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq" pod "85b278f9-7ee1-48fa-856d-0972ed08cefe" (UID: "85b278f9-7ee1-48fa-856d-0972ed08cefe"). InnerVolumeSpecName "kube-api-access-tf8xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:16.074419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.050924    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca" pod "85b278f9-7ee1-48fa-856d-0972ed08cefe" (UID: "85b278f9-7ee1-48fa-856d-0972ed08cefe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:16.074419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.062044    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls" pod "85b278f9-7ee1-48fa-856d-0972ed08cefe" (UID: "85b278f9-7ee1-48fa-856d-0972ed08cefe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:16.074419 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.070102    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs" pod "85b278f9-7ee1-48fa-856d-0972ed08cefe" (UID: "85b278f9-7ee1-48fa-856d-0972ed08cefe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:16.147178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.146665    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:16.147178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.146706    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf8xq\" (UniqueName: \"kubernetes.io/projected/85b278f9-7ee1-48fa-856d-0972ed08cefe-kube-api-access-tf8xq\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:16.147178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.146722    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b278f9-7ee1-48fa-856d-0972ed08cefe-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:16.147178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.146736    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b278f9-7ee1-48fa-856d-0972ed08cefe-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:16.557606 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.557569    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerStarted","Data":"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"}
Oct 30 22:24:16.559599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.559574    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:24:16.559890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.559873    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:16.560034 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.560017    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:16.561032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.561007    5967 generic.go:356] "Generic (PLEG): container finished" podID="85b278f9-7ee1-48fa-856d-0972ed08cefe" containerID="b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17" exitCode=0
Oct 30 22:24:16.561149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.561076    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" event={"ID":"85b278f9-7ee1-48fa-856d-0972ed08cefe","Type":"ContainerDied","Data":"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"}
Oct 30 22:24:16.561149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.561116    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt" event={"ID":"85b278f9-7ee1-48fa-856d-0972ed08cefe","Type":"ContainerDied","Data":"610a0cad002a3480c82af874fd8531d2580843da937ffe46ea1e52b1783e149c"}
Oct 30 22:24:16.561273 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.561142    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"
Oct 30 22:24:16.561273 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.561159    5967 scope.go:122] "RemoveContainer" containerID="b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"
Oct 30 22:24:16.587917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.586299    5967 scope.go:122] "RemoveContainer" containerID="b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"
Oct 30 22:24:16.588586 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:16.588479    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17\": container with ID starting with b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17 not found: ID does not exist" containerID="b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"
Oct 30 22:24:16.588586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.588524    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17"} err="failed to get container status \"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17\": rpc error: code = NotFound desc = could not find container \"b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17\": container with ID starting with b0bf7167414870f95e49ef3a011ba3ff6d1dadea47c8b9722656b52f1b162f17 not found: ID does not exist"
Oct 30 22:24:16.816016 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.815921    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:24:16.816280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:16.816263    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9a96b4-569fd77b8b-lkdxt"]
Oct 30 22:24:17.559721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:17.559677    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:17.560228 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:17.559757    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:18.019050 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:18.019016    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85b278f9-7ee1-48fa-856d-0972ed08cefe" path="/var/lib/kubelet/pods/85b278f9-7ee1-48fa-856d-0972ed08cefe/volumes"
Oct 30 22:24:18.560319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:18.560279    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:18.560788 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:18.560337    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:19.559591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:19.559558    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:19.559813 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:19.559617    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:20.560329 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:20.560288    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:20.560794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:20.560352    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:21.197397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:21.193471    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:24:21.560512 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:21.560483    5967 patch_prober.go:29] interesting pod/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:24:21.560952 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:21.560533    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Oct 30 22:24:22.564786 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:22.564758    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:24:22.565840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:22.565823    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:24:32.702053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:32.702010    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:24:32.702582 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:32.702203    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api" containerID="cri-o://ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7" gracePeriod=30
Oct 30 22:24:33.154130 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.154102    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:24:33.228213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.228179    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\") pod \"5aed3651-9994-43c9-9465-18ab7cde4a56\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") "
Oct 30 22:24:33.228434 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.228415    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") pod \"5aed3651-9994-43c9-9465-18ab7cde4a56\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") "
Oct 30 22:24:33.228551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.228535    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\") pod \"5aed3651-9994-43c9-9465-18ab7cde4a56\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") "
Oct 30 22:24:33.228609 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.228582    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\" (UniqueName: \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\") pod \"5aed3651-9994-43c9-9465-18ab7cde4a56\" (UID: \"5aed3651-9994-43c9-9465-18ab7cde4a56\") "
Oct 30 22:24:33.229815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.229732    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca" pod "5aed3651-9994-43c9-9465-18ab7cde4a56" (UID: "5aed3651-9994-43c9-9465-18ab7cde4a56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:33.231323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.231294    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls" pod "5aed3651-9994-43c9-9465-18ab7cde4a56" (UID: "5aed3651-9994-43c9-9465-18ab7cde4a56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:33.231323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.231304    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm" pod "5aed3651-9994-43c9-9465-18ab7cde4a56" (UID: "5aed3651-9994-43c9-9465-18ab7cde4a56"). InnerVolumeSpecName "kube-api-access-79sxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:33.231783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.231762    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs" pod "5aed3651-9994-43c9-9465-18ab7cde4a56" (UID: "5aed3651-9994-43c9-9465-18ab7cde4a56"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:33.330060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.330019    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:33.330060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.330054    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aed3651-9994-43c9-9465-18ab7cde4a56-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:33.330270 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.330069    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79sxm\" (UniqueName: \"kubernetes.io/projected/5aed3651-9994-43c9-9465-18ab7cde4a56-kube-api-access-79sxm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:33.330270 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.330082    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aed3651-9994-43c9-9465-18ab7cde4a56-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:33.696262 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.696228    5967 generic.go:356] "Generic (PLEG): container finished" podID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerID="ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7" exitCode=0
Oct 30 22:24:33.696466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.696279    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"
Oct 30 22:24:33.696466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.696316    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerDied","Data":"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"}
Oct 30 22:24:33.696466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.696394    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq" event={"ID":"5aed3651-9994-43c9-9465-18ab7cde4a56","Type":"ContainerDied","Data":"c3c89a378cad2daf0963360b3a79c8fde566bc32feabd7d691ca02f62a62cfcc"}
Oct 30 22:24:33.696466 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.696418    5967 scope.go:122] "RemoveContainer" containerID="ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"
Oct 30 22:24:33.709273 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.709253    5967 scope.go:122] "RemoveContainer" containerID="bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"
Oct 30 22:24:33.730915 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.730893    5967 scope.go:122] "RemoveContainer" containerID="ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"
Oct 30 22:24:33.731233 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:33.731215    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7\": container with ID starting with ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7 not found: ID does not exist" containerID="ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"
Oct 30 22:24:33.731278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.731254    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7"} err="failed to get container status \"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7\": rpc error: code = NotFound desc = could not find container \"ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7\": container with ID starting with ab10942da42261e8ed2bf04f9bff37a88f061239fdf592a23a61d27eb1fff8d7 not found: ID does not exist"
Oct 30 22:24:33.731278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.731276    5967 scope.go:122] "RemoveContainer" containerID="bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"
Oct 30 22:24:33.731606 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:33.731587    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a\": container with ID starting with bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a not found: ID does not exist" containerID="bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"
Oct 30 22:24:33.731675 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.731613    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a"} err="failed to get container status \"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a\": rpc error: code = NotFound desc = could not find container \"bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a\": container with ID starting with bd49c1e1574018b20a09e49a33dc6862533ccb1ce70e731e5bbc14fb0d42995a not found: ID does not exist"
Oct 30 22:24:33.863355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.863312    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:24:33.912814 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:33.912781    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e3324355-579786b4fb-9nmvq"]
Oct 30 22:24:34.019524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:34.019497    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" path="/var/lib/kubelet/pods/5aed3651-9994-43c9-9465-18ab7cde4a56/volumes"
Oct 30 22:24:35.593160 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:35.593124    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:24:44.853587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:44.853553    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:24:44.854147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:44.853807    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" podUID="a10631d8-ccc5-451e-af3e-279209822140" containerName="maas-api" containerID="cri-o://df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a" gracePeriod=30
Oct 30 22:24:44.953809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:44.953772    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:24:44.956665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:44.956631    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:24:45.314409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.312722    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:24:45.400861 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.400818    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") pod \"a10631d8-ccc5-451e-af3e-279209822140\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") "
Oct 30 22:24:45.401054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.400990    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\" (UniqueName: \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\") pod \"a10631d8-ccc5-451e-af3e-279209822140\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") "
Oct 30 22:24:45.401054 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.401040    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\") pod \"a10631d8-ccc5-451e-af3e-279209822140\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") "
Oct 30 22:24:45.401169 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.401089    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\") pod \"a10631d8-ccc5-451e-af3e-279209822140\" (UID: \"a10631d8-ccc5-451e-af3e-279209822140\") "
Oct 30 22:24:45.401458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.401427    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca" pod "a10631d8-ccc5-451e-af3e-279209822140" (UID: "a10631d8-ccc5-451e-af3e-279209822140"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:45.401835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.401744    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a10631d8-ccc5-451e-af3e-279209822140-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:45.403727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.403642    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb" pod "a10631d8-ccc5-451e-af3e-279209822140" (UID: "a10631d8-ccc5-451e-af3e-279209822140"). InnerVolumeSpecName "kube-api-access-r68rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:45.404196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.404166    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs" pod "a10631d8-ccc5-451e-af3e-279209822140" (UID: "a10631d8-ccc5-451e-af3e-279209822140"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:45.404418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.404331    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls" pod "a10631d8-ccc5-451e-af3e-279209822140" (UID: "a10631d8-ccc5-451e-af3e-279209822140"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:45.504284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.503607    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:45.504284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.504247    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r68rb\" (UniqueName: \"kubernetes.io/projected/a10631d8-ccc5-451e-af3e-279209822140-kube-api-access-r68rb\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:45.504284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.504269    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10631d8-ccc5-451e-af3e-279209822140-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:45.780553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.780478    5967 generic.go:356] "Generic (PLEG): container finished" podID="a10631d8-ccc5-451e-af3e-279209822140" containerID="df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a" exitCode=0
Oct 30 22:24:45.780553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.780523    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"
Oct 30 22:24:45.780734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.780563    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" event={"ID":"a10631d8-ccc5-451e-af3e-279209822140","Type":"ContainerDied","Data":"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"}
Oct 30 22:24:45.780734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.780643    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr" event={"ID":"a10631d8-ccc5-451e-af3e-279209822140","Type":"ContainerDied","Data":"e8d074842128f91636112b37a46e28cf55a30e25a3197a0fa0b3d740ef0f76f5"}
Oct 30 22:24:45.780734 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.780667    5967 scope.go:122] "RemoveContainer" containerID="df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"
Oct 30 22:24:45.791098 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.791079    5967 scope.go:122] "RemoveContainer" containerID="df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"
Oct 30 22:24:45.791413 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:24:45.791356    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a\": container with ID starting with df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a not found: ID does not exist" containerID="df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"
Oct 30 22:24:45.791536 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.791421    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a"} err="failed to get container status \"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a\": rpc error: code = NotFound desc = could not find container \"df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a\": container with ID starting with df1dd5f9bc8d9dae6ee1bb1d2dedb4ace67f522b1662afef53f6004ebb83275a not found: ID does not exist"
Oct 30 22:24:45.947442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.947352    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:24:45.952653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:45.952622    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2d8852-5999d6586-rl2qr"]
Oct 30 22:24:46.018893 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:46.018855    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a10631d8-ccc5-451e-af3e-279209822140" path="/var/lib/kubelet/pods/a10631d8-ccc5-451e-af3e-279209822140/volumes"
Oct 30 22:24:59.977688 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:59.977626    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main" containerID="cri-o://11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46" gracePeriod=45
Oct 30 22:24:59.979110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:24:59.979080    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main" containerID="cri-o://f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77" gracePeriod=45
Oct 30 22:25:00.276794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.276762    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:25:00.280420 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.280399    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:25:00.349810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349768    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.349810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349811    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.350070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349875    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349905    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349964    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.349997    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\" (UniqueName: \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.350070 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350058    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350085    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350122    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350133    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350171    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350223    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\" (UniqueName: \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350247    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.350313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350283    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\") pod \"1716a902-5d8d-4418-a2d6-5f80127b91b3\" (UID: \"1716a902-5d8d-4418-a2d6-5f80127b91b3\") "
Oct 30 22:25:00.350736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350358    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\" (UniqueName: \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\") pod \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\" (UID: \"2b974ae9-6130-4dc1-aaed-7ceaccb377c1\") "
Oct 30 22:25:00.350736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350416    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.350736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350499    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.350902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.350785    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.351119 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351090    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.351272 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351123    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.351272 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351167    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.351272 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351182    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.351272 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351196    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.351272 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.351210    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.352715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.352689    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:00.353027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.352991    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.353153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.353088    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.353245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.353217    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "kube-api-access-vz2nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:00.353455 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.353436    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn" pod "2b974ae9-6130-4dc1-aaed-7ceaccb377c1" (UID: "2b974ae9-6130-4dc1-aaed-7ceaccb377c1"). InnerVolumeSpecName "kube-api-access-fcgdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:00.353504 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.353465    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs" pod "1716a902-5d8d-4418-a2d6-5f80127b91b3" (UID: "1716a902-5d8d-4418-a2d6-5f80127b91b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:00.452659 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452628    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcgdn\" (UniqueName: \"kubernetes.io/projected/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-kube-api-access-fcgdn\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.452659 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452657    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1716a902-5d8d-4418-a2d6-5f80127b91b3-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.452872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452669    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.452872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452677    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1716a902-5d8d-4418-a2d6-5f80127b91b3-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.452872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452690    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b974ae9-6130-4dc1-aaed-7ceaccb377c1-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.452872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.452701    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz2nf\" (UniqueName: \"kubernetes.io/projected/1716a902-5d8d-4418-a2d6-5f80127b91b3-kube-api-access-vz2nf\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.888233 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.888197    5967 generic.go:356] "Generic (PLEG): container finished" podID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerID="f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77" exitCode=0
Oct 30 22:25:00.888497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.888250    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"
Oct 30 22:25:00.888497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.888286    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" event={"ID":"2b974ae9-6130-4dc1-aaed-7ceaccb377c1","Type":"ContainerDied","Data":"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"}
Oct 30 22:25:00.888497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.888340    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt" event={"ID":"2b974ae9-6130-4dc1-aaed-7ceaccb377c1","Type":"ContainerDied","Data":"aa233a3c9b00a72a3755f7370e84cb92be5c4bbad251f180c2ed8ebd78e45f79"}
Oct 30 22:25:00.888497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.888363    5967 scope.go:122] "RemoveContainer" containerID="f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"
Oct 30 22:25:00.890073 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.890040    5967 generic.go:356] "Generic (PLEG): container finished" podID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerID="11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46" exitCode=0
Oct 30 22:25:00.890212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.890091    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"
Oct 30 22:25:00.890212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.890118    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" event={"ID":"1716a902-5d8d-4418-a2d6-5f80127b91b3","Type":"ContainerDied","Data":"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"}
Oct 30 22:25:00.890212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.890161    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c" event={"ID":"1716a902-5d8d-4418-a2d6-5f80127b91b3","Type":"ContainerDied","Data":"d5ae921f2e25b85f876f3b73b9be629c5e81078b0de17cb291a0e1dc68f8afdb"}
Oct 30 22:25:00.899105 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.899085    5967 scope.go:122] "RemoveContainer" containerID="f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"
Oct 30 22:25:00.899529 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:00.899449    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77\": container with ID starting with f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77 not found: ID does not exist" containerID="f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"
Oct 30 22:25:00.899529 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.899488    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77"} err="failed to get container status \"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77\": rpc error: code = NotFound desc = could not find container \"f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77\": container with ID starting with f5de660a76a0618d91182c8437f345993678af2c9ddb51a72af81300500abb77 not found: ID does not exist"
Oct 30 22:25:00.899529 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.899514    5967 scope.go:122] "RemoveContainer" containerID="11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"
Oct 30 22:25:00.910163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.910141    5967 scope.go:122] "RemoveContainer" containerID="11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"
Oct 30 22:25:00.910539 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:00.910518    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46\": container with ID starting with 11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46 not found: ID does not exist" containerID="11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"
Oct 30 22:25:00.910613 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:00.910551    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46"} err="failed to get container status \"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46\": rpc error: code = NotFound desc = could not find container \"11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46\": container with ID starting with 11da39f5040c4a87463142c62a5f753db9b746273dc773dc2b4cb2d570d4ff46 not found: ID does not exist"
Oct 30 22:25:01.053620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:01.053584    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:25:01.060458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:01.060428    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/premium-w1-bf7cbf-kserve-76b8758cb7-dq27c"]
Oct 30 22:25:01.168110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:01.168023    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:25:01.173934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:01.173908    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-bf7cbf/simulator-w1-bf7cbf-kserve-7778f7c778-lplqt"]
Oct 30 22:25:02.018113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:02.018083    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" path="/var/lib/kubelet/pods/1716a902-5d8d-4418-a2d6-5f80127b91b3/volumes"
Oct 30 22:25:02.018538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:02.018525    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" path="/var/lib/kubelet/pods/2b974ae9-6130-4dc1-aaed-7ceaccb377c1/volumes"
Oct 30 22:25:05.597198 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:05.597155    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:25:07.617887 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:07.617856    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:25:07.618306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:07.618046    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" podUID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" containerName="maas-api" containerID="cri-o://899c7a7ac791a33b0ff5bf8b3af2c39fbe396b5d1dc679feb33bb1f192904e24" gracePeriod=30
Oct 30 22:25:07.953654 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:07.953358    5967 generic.go:356] "Generic (PLEG): container finished" podID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" containerID="899c7a7ac791a33b0ff5bf8b3af2c39fbe396b5d1dc679feb33bb1f192904e24" exitCode=0
Oct 30 22:25:07.953654 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:07.953591    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" event={"ID":"507da48b-7a51-4c41-b5d9-5b97ca565ad6","Type":"ContainerDied","Data":"899c7a7ac791a33b0ff5bf8b3af2c39fbe396b5d1dc679feb33bb1f192904e24"}
Oct 30 22:25:07.991847 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:07.991820    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:25:08.075080 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075040    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\") pod \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") "
Oct 30 22:25:08.075275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075093    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") pod \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") "
Oct 30 22:25:08.075275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075258    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\") pod \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") "
Oct 30 22:25:08.075423 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075282    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\" (UniqueName: \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\") pod \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\" (UID: \"507da48b-7a51-4c41-b5d9-5b97ca565ad6\") "
Oct 30 22:25:08.075677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075648    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca" pod "507da48b-7a51-4c41-b5d9-5b97ca565ad6" (UID: "507da48b-7a51-4c41-b5d9-5b97ca565ad6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:08.076125 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.075869    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/507da48b-7a51-4c41-b5d9-5b97ca565ad6-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:08.077546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.077525    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs" pod "507da48b-7a51-4c41-b5d9-5b97ca565ad6" (UID: "507da48b-7a51-4c41-b5d9-5b97ca565ad6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:08.078068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.078052    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl" pod "507da48b-7a51-4c41-b5d9-5b97ca565ad6" (UID: "507da48b-7a51-4c41-b5d9-5b97ca565ad6"). InnerVolumeSpecName "kube-api-access-449rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:08.078190 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.078177    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls" pod "507da48b-7a51-4c41-b5d9-5b97ca565ad6" (UID: "507da48b-7a51-4c41-b5d9-5b97ca565ad6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:08.177207 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.177118    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-449rl\" (UniqueName: \"kubernetes.io/projected/507da48b-7a51-4c41-b5d9-5b97ca565ad6-kube-api-access-449rl\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:08.177207 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.177157    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:08.177207 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.177173    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/507da48b-7a51-4c41-b5d9-5b97ca565ad6-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:08.960642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.960565    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"
Oct 30 22:25:08.960642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.960594    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r" event={"ID":"507da48b-7a51-4c41-b5d9-5b97ca565ad6","Type":"ContainerDied","Data":"69e0b452818005530cc6c3ff5e3359dd4c1de75a1c34a2a06d03364460d35b24"}
Oct 30 22:25:08.961136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:08.960662    5967 scope.go:122] "RemoveContainer" containerID="899c7a7ac791a33b0ff5bf8b3af2c39fbe396b5d1dc679feb33bb1f192904e24"
Oct 30 22:25:09.125925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:09.125892    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:25:09.175424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:09.175393    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-0f3344-5d9d757d4f-rw28r"]
Oct 30 22:25:10.019911 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:10.019857    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" path="/var/lib/kubelet/pods/507da48b-7a51-4c41-b5d9-5b97ca565ad6/volumes"
Oct 30 22:25:15.279112 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:15.279067    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:25:15.306426 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:15.306364    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:25:35.593009 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:35.592968    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:25:40.730940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:40.730897    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:25:40.779761 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:40.779731    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:25:46.376685 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:46.376651    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:25:46.426917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:46.426885    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 22:25:47.690511 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.690468    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:25:47.691028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691014    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main"
Oct 30 22:25:47.691079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691031    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main"
Oct 30 22:25:47.691079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691044    5967 cpu_manager.go:414] "containerMap: removing container" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main"
Oct 30 22:25:47.691079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691049    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main"
Oct 30 22:25:47.691079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691071    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:25:47.691079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691075    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691093    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691098    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691113    5967 cpu_manager.go:414] "containerMap: removing container" podUID="85b278f9-7ee1-48fa-856d-0972ed08cefe" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691120    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85b278f9-7ee1-48fa-856d-0972ed08cefe" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691141    5967 cpu_manager.go:414] "containerMap: removing container" podUID="a10631d8-ccc5-451e-af3e-279209822140" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691145    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a10631d8-ccc5-451e-af3e-279209822140" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691153    5967 cpu_manager.go:414] "containerMap: removing container" podUID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691158    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691253    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691265    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="85b278f9-7ee1-48fa-856d-0972ed08cefe" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691279    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="a10631d8-ccc5-451e-af3e-279209822140" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691288    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="507da48b-7a51-4c41-b5d9-5b97ca565ad6" containerName="maas-api"
Oct 30 22:25:47.691291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691294    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b974ae9-6130-4dc1-aaed-7ceaccb377c1" containerName="main"
Oct 30 22:25:47.692088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.691300    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="1716a902-5d8d-4418-a2d6-5f80127b91b3" containerName="main"
Oct 30 22:25:47.694582 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.694561    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.747148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.747115    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-bf7cbf-openshift-default-dockercfg-7rlzz\""
Oct 30 22:25:47.800445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.800414    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:25:47.811222 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811194    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811242    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811331    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811358    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811471    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811519    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2br\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.811754 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811652    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.812273 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.811897    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.812273 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.812028    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913385 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913333    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913521    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913570    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913598    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913635    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913692    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913714    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913724    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2br\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913805    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913850    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.913973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913888    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.914161 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.913994    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.914216 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.914168    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.914492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.914475    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.915901 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.915879    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.916215 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.916195    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.975216 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.975188    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:47.975427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:47.975293    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2br\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:48.008995 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:48.008968    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:48.449932 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:48.449805    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:25:48.481778 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:25:48.481748    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28c6d7a_269a_4551_8231_b469743b4f76.slice/crio-a88fdf971970dd97949c30dcc93314bdb01920a4e2ddd5e69708ca9c98743216 WatchSource:0}: Error finding container a88fdf971970dd97949c30dcc93314bdb01920a4e2ddd5e69708ca9c98743216: Status 404 returned error can't find the container with id a88fdf971970dd97949c30dcc93314bdb01920a4e2ddd5e69708ca9c98743216
Oct 30 22:25:48.484201 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:48.484169    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:25:48.484278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:48.484238    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:25:48.484278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:48.484267    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:25:49.238669 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:49.238628    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" event={"ID":"b28c6d7a-269a-4551-8231-b469743b4f76","Type":"ContainerStarted","Data":"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"}
Oct 30 22:25:49.246966 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:49.238699    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" event={"ID":"b28c6d7a-269a-4551-8231-b469743b4f76","Type":"ContainerStarted","Data":"a88fdf971970dd97949c30dcc93314bdb01920a4e2ddd5e69708ca9c98743216"}
Oct 30 22:25:49.381057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:49.381005    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podStartSLOduration=2.380989679 podStartE2EDuration="2.380989679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:49.379929695 +0000 UTC m=+2437.494638049" watchObservedRunningTime="2026-10-30 22:25:49.380989679 +0000 UTC m=+2437.495698029"
Oct 30 22:25:50.009557 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:50.009519    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:50.011761 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:50.011725    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:50.011929 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:50.011803    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:51.009983 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:51.009945    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:51.010515 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:51.010031    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:52.009802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:52.009765    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:52.009972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:52.009831    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:52.321927 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:52.321844    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 22:25:53.010154 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:53.010115    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:53.010418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:53.010170    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:53.541960 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:53.541920    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 22:25:53.542442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:53.542157    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" podUID="d9b011fb-a656-4889-8d95-71adabe71a51" containerName="maas-api" containerID="cri-o://c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e" gracePeriod=30
Oct 30 22:25:54.019088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.017767    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:54.019088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.017832    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:54.081405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.081360    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 22:25:54.204400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.203904    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\" (UniqueName: \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\") pod \"d9b011fb-a656-4889-8d95-71adabe71a51\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") "
Oct 30 22:25:54.204400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.204023    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\") pod \"d9b011fb-a656-4889-8d95-71adabe71a51\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") "
Oct 30 22:25:54.204400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.204134    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\") pod \"d9b011fb-a656-4889-8d95-71adabe71a51\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") "
Oct 30 22:25:54.204400 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.204187    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") pod \"d9b011fb-a656-4889-8d95-71adabe71a51\" (UID: \"d9b011fb-a656-4889-8d95-71adabe71a51\") "
Oct 30 22:25:54.219349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.218975    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca" pod "d9b011fb-a656-4889-8d95-71adabe71a51" (UID: "d9b011fb-a656-4889-8d95-71adabe71a51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:54.219840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.219810    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls" pod "d9b011fb-a656-4889-8d95-71adabe71a51" (UID: "d9b011fb-a656-4889-8d95-71adabe71a51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:54.220320 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.220292    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt" pod "d9b011fb-a656-4889-8d95-71adabe71a51" (UID: "d9b011fb-a656-4889-8d95-71adabe71a51"). InnerVolumeSpecName "kube-api-access-ljzkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:54.221673 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.221636    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs" pod "d9b011fb-a656-4889-8d95-71adabe71a51" (UID: "d9b011fb-a656-4889-8d95-71adabe71a51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:54.271162 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.271131    5967 generic.go:356] "Generic (PLEG): container finished" podID="d9b011fb-a656-4889-8d95-71adabe71a51" containerID="c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e" exitCode=0
Oct 30 22:25:54.271338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.271195    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"
Oct 30 22:25:54.271338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.271222    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" event={"ID":"d9b011fb-a656-4889-8d95-71adabe71a51","Type":"ContainerDied","Data":"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"}
Oct 30 22:25:54.271338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.271299    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp" event={"ID":"d9b011fb-a656-4889-8d95-71adabe71a51","Type":"ContainerDied","Data":"29a7d7a176d327b093599ecf4455489cfaa17df8362c80c15672b99799e060ad"}
Oct 30 22:25:54.271338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.271322    5967 scope.go:122] "RemoveContainer" containerID="c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"
Oct 30 22:25:54.281205 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.281179    5967 scope.go:122] "RemoveContainer" containerID="c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"
Oct 30 22:25:54.281645 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:54.281533    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e\": container with ID starting with c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e not found: ID does not exist" containerID="c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"
Oct 30 22:25:54.281645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.281570    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e"} err="failed to get container status \"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e\": rpc error: code = NotFound desc = could not find container \"c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e\": container with ID starting with c55ffb9d635679b9be8f4baed0bdd7d93f1ddbae50315daa811f96370b488d2e not found: ID does not exist"
Oct 30 22:25:54.314099 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.313954    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:54.314099 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.313994    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b011fb-a656-4889-8d95-71adabe71a51-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:54.314099 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.314005    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljzkt\" (UniqueName: \"kubernetes.io/projected/d9b011fb-a656-4889-8d95-71adabe71a51-kube-api-access-ljzkt\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:54.314099 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.314015    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b011fb-a656-4889-8d95-71adabe71a51-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:54.436261 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.436223    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 22:25:54.442046 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:54.442020    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-bf7cbf-7fff4847c8-zlcjp"]
Oct 30 22:25:55.009784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:55.009750    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:25:55.010295 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:55.009810    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Oct 30 22:25:55.773708 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:55.772840    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main" containerID="cri-o://23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5" gracePeriod=45
Oct 30 22:25:55.801102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:55.800924    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" containerID="cri-o://1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f" gracePeriod=45
Oct 30 22:25:56.030023 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.029943    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9b011fb-a656-4889-8d95-71adabe71a51" path="/var/lib/kubelet/pods/d9b011fb-a656-4889-8d95-71adabe71a51/volumes"
Oct 30 22:25:56.157686 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.157657    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:25:56.167728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.167696    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:25:56.246550 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246512    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\" (UniqueName: \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.246739 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246629    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\" (UniqueName: \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.246739 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246661    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.246860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246751    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.246860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246794    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.246860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246850    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.247009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246930    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.247009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246969    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\" (UniqueName: \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\") pod \"38055ab8-0c2f-483a-ad13-4502b10326cb\" (UID: \"38055ab8-0c2f-483a-ad13-4502b10326cb\") "
Oct 30 22:25:56.247009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.246985    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.247152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247028    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.247152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247062    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.247152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247108    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.247297 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247164    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\") pod \"eedca670-799e-4929-95cc-2661490cca66\" (UID: \"eedca670-799e-4929-95cc-2661490cca66\") "
Oct 30 22:25:56.247435 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247351    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.247621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247601    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.247799 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247780    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.247867 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247807    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.247867 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247825    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.247867 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247788    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.248030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.247971    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.248257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.248204    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.249735 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.249710    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "kube-api-access-w5zw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:56.249735 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.249718    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "kube-api-access-mnvkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:56.250243 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.250220    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.250365 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.250322    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:56.250365 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.250330    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm" pod "38055ab8-0c2f-483a-ad13-4502b10326cb" (UID: "38055ab8-0c2f-483a-ad13-4502b10326cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:56.251494 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.251476    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs" pod "eedca670-799e-4929-95cc-2661490cca66" (UID: "eedca670-799e-4929-95cc-2661490cca66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:56.291437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.286900    5967 generic.go:356] "Generic (PLEG): container finished" podID="eedca670-799e-4929-95cc-2661490cca66" containerID="23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5" exitCode=0
Oct 30 22:25:56.291437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.286993    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" event={"ID":"eedca670-799e-4929-95cc-2661490cca66","Type":"ContainerDied","Data":"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"}
Oct 30 22:25:56.291437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.287030    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz" event={"ID":"eedca670-799e-4929-95cc-2661490cca66","Type":"ContainerDied","Data":"90b8925ced69dbaefb51ec028d73b7ed20527f5b2c6b844d9a46b770f4a2084f"}
Oct 30 22:25:56.291437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.287052    5967 scope.go:122] "RemoveContainer" containerID="23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"
Oct 30 22:25:56.291437 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.287152    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"
Oct 30 22:25:56.295325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.295296    5967 generic.go:356] "Generic (PLEG): container finished" podID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerID="1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f" exitCode=0
Oct 30 22:25:56.295593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.295571    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" event={"ID":"38055ab8-0c2f-483a-ad13-4502b10326cb","Type":"ContainerDied","Data":"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"}
Oct 30 22:25:56.295697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.295615    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" event={"ID":"38055ab8-0c2f-483a-ad13-4502b10326cb","Type":"ContainerDied","Data":"b1039c9ab2c6c19b487dd1ff8955dd092ab1a8bd30c9d59b480519474a350590"}
Oct 30 22:25:56.295697 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.295683    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"
Oct 30 22:25:56.310665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.310598    5967 scope.go:122] "RemoveContainer" containerID="23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"
Oct 30 22:25:56.310956 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:56.310937    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5\": container with ID starting with 23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5 not found: ID does not exist" containerID="23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"
Oct 30 22:25:56.311048 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.310964    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5"} err="failed to get container status \"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5\": rpc error: code = NotFound desc = could not find container \"23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5\": container with ID starting with 23faa17d2ea3d7994d110bc2607e0e53cde7d7c7b8e2bf6b5bae05b69ecc1bd5 not found: ID does not exist"
Oct 30 22:25:56.311048 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.310989    5967 scope.go:122] "RemoveContainer" containerID="1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"
Oct 30 22:25:56.326849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.324495    5967 scope.go:122] "RemoveContainer" containerID="1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"
Oct 30 22:25:56.326849 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:25:56.325562    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f\": container with ID starting with 1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f not found: ID does not exist" containerID="1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"
Oct 30 22:25:56.326849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.325598    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f"} err="failed to get container status \"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f\": rpc error: code = NotFound desc = could not find container \"1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f\": container with ID starting with 1fbb00e4c2d419d39ab0e03a7f3d119f5f148de50a93f92065277918d7fd6e6f not found: ID does not exist"
Oct 30 22:25:56.349177 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349142    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38055ab8-0c2f-483a-ad13-4502b10326cb-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349181    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eedca670-799e-4929-95cc-2661490cca66-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349196    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349235    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349251    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnvkc\" (UniqueName: \"kubernetes.io/projected/38055ab8-0c2f-483a-ad13-4502b10326cb-kube-api-access-mnvkc\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349267    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5zw2\" (UniqueName: \"kubernetes.io/projected/eedca670-799e-4929-95cc-2661490cca66-kube-api-access-w5zw2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349281    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedca670-799e-4929-95cc-2661490cca66-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349295    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.349360 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.349307    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38055ab8-0c2f-483a-ad13-4502b10326cb-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:56.506509 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.506477    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:25:56.509238 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.509214    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-2-w3-cef074-kserve-c66c68768-62lpz"]
Oct 30 22:25:56.623430 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.623288    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:25:56.627043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:56.627010    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl"]
Oct 30 22:25:57.050521 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.050483    5967 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:25:57.050945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.050534    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:25:57.050945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.050717    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-cef074/distinct-w3-cef074-kserve-7c9fd7d575-pg8fl" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:25:57.247481 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.247439    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:57.247849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.247829    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:57.249809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.249782    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:25:57.322238 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:57.322155    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing" containerID="cri-o://8126059cc6559d6d84f83ba02a3df86c3b63ad4454a813844c66d899dfcddc56" gracePeriod=25
Oct 30 22:25:58.020291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:58.020254    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" path="/var/lib/kubelet/pods/38055ab8-0c2f-483a-ad13-4502b10326cb/volumes"
Oct 30 22:25:58.020723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:25:58.020706    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eedca670-799e-4929-95cc-2661490cca66" path="/var/lib/kubelet/pods/eedca670-799e-4929-95cc-2661490cca66/volumes"
Oct 30 22:26:00.590684 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:00.590648    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:26:00.591119 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:00.590876    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" podUID="27027312-9922-439f-926d-14ca281f4ab5" containerName="maas-api" containerID="cri-o://1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a" gracePeriod=30
Oct 30 22:26:00.939180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:00.939150    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:26:01.063408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.063337    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\") pod \"27027312-9922-439f-926d-14ca281f4ab5\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") "
Oct 30 22:26:01.063606 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.063516    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") pod \"27027312-9922-439f-926d-14ca281f4ab5\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") "
Oct 30 22:26:01.063668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.063617    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\" (UniqueName: \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\") pod \"27027312-9922-439f-926d-14ca281f4ab5\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") "
Oct 30 22:26:01.063724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.063687    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\") pod \"27027312-9922-439f-926d-14ca281f4ab5\" (UID: \"27027312-9922-439f-926d-14ca281f4ab5\") "
Oct 30 22:26:01.064100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.064059    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca" pod "27027312-9922-439f-926d-14ca281f4ab5" (UID: "27027312-9922-439f-926d-14ca281f4ab5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:01.064260 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.064197    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27027312-9922-439f-926d-14ca281f4ab5-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.067531 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.067460    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs" pod "27027312-9922-439f-926d-14ca281f4ab5" (UID: "27027312-9922-439f-926d-14ca281f4ab5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:01.067714 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.067560    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls" pod "27027312-9922-439f-926d-14ca281f4ab5" (UID: "27027312-9922-439f-926d-14ca281f4ab5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:01.067782 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.067751    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd" pod "27027312-9922-439f-926d-14ca281f4ab5" (UID: "27027312-9922-439f-926d-14ca281f4ab5"). InnerVolumeSpecName "kube-api-access-pgzrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:01.166971 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.166893    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.167179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.167154    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgzrd\" (UniqueName: \"kubernetes.io/projected/27027312-9922-439f-926d-14ca281f4ab5-kube-api-access-pgzrd\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.167179 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.167182    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27027312-9922-439f-926d-14ca281f4ab5-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.340715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.340678    5967 generic.go:356] "Generic (PLEG): container finished" podID="27027312-9922-439f-926d-14ca281f4ab5" containerID="1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a" exitCode=0
Oct 30 22:26:01.340934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.340743    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"
Oct 30 22:26:01.340934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.340759    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" event={"ID":"27027312-9922-439f-926d-14ca281f4ab5","Type":"ContainerDied","Data":"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"}
Oct 30 22:26:01.340934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.340833    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw" event={"ID":"27027312-9922-439f-926d-14ca281f4ab5","Type":"ContainerDied","Data":"2d3b63a5a03710a1382fe3f9a4e6aab7778271825dd3bd7987c9de7bd9f7780b"}
Oct 30 22:26:01.340934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.340863    5967 scope.go:122] "RemoveContainer" containerID="1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"
Oct 30 22:26:01.353152 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.353132    5967 scope.go:122] "RemoveContainer" containerID="1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"
Oct 30 22:26:01.353602 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:01.353580    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a\": container with ID starting with 1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a not found: ID does not exist" containerID="1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"
Oct 30 22:26:01.353675 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.353614    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a"} err="failed to get container status \"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a\": rpc error: code = NotFound desc = could not find container \"1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a\": container with ID starting with 1b4e0410760419d9c3dc51e71beb6d5abd9593d025e684ea3e11465b8fecb41a not found: ID does not exist"
Oct 30 22:26:01.398594 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.398550    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" containerID="cri-o://d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597" gracePeriod=45
Oct 30 22:26:01.409188 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.409158    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": dial tcp 10.134.0.48:8000: connect: connection refused"
Oct 30 22:26:01.447196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.447119    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main" containerID="cri-o://dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3" gracePeriod=45
Oct 30 22:26:01.509463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.509357    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:26:01.514507 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.514483    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-25237a-5f56dbc887-ptfsw"]
Oct 30 22:26:01.779412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.771009    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:26:01.820636 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.820611    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:26:01.877711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877685    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.877864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877731    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.877864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877764    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.877864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877781    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.877864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877815    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\" (UniqueName: \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.878084 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.877890    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\" (UniqueName: \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\") pod \"de8fb258-289f-4af8-bba0-77330ff92732\" (UID: \"de8fb258-289f-4af8-bba0-77330ff92732\") "
Oct 30 22:26:01.878084 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878005    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.878084 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878018    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.878084 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878034    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.878415 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878394    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.878415 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878415    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.878586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.878429    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.880102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.880084    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.880193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.880123    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:01.880193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.880158    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p" pod "de8fb258-289f-4af8-bba0-77330ff92732" (UID: "de8fb258-289f-4af8-bba0-77330ff92732"). InnerVolumeSpecName "kube-api-access-j476p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:01.979277 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979230    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.979531 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979350    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.979531 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979517    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.979699 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979573    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\" (UniqueName: \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.979699 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979629    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.979699 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979697    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\") pod \"cd840947-3699-4ae5-b1b7-7eda545c95fc\" (UID: \"cd840947-3699-4ae5-b1b7-7eda545c95fc\") "
Oct 30 22:26:01.980221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.979921    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.980221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980169    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.980446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980256    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j476p\" (UniqueName: \"kubernetes.io/projected/de8fb258-289f-4af8-bba0-77330ff92732-kube-api-access-j476p\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.980446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980276    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de8fb258-289f-4af8-bba0-77330ff92732-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.980446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980290    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.980446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980305    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de8fb258-289f-4af8-bba0-77330ff92732-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.980446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.980435    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.982224 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.982195    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:01.982766 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.982741    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.983091 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:01.983071    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs" pod "cd840947-3699-4ae5-b1b7-7eda545c95fc" (UID: "cd840947-3699-4ae5-b1b7-7eda545c95fc"). InnerVolumeSpecName "kube-api-access-s2wrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:02.018412 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.018299    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27027312-9922-439f-926d-14ca281f4ab5" path="/var/lib/kubelet/pods/27027312-9922-439f-926d-14ca281f4ab5/volumes"
Oct 30 22:26:02.082100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.082065    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:02.082100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.082099    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2wrs\" (UniqueName: \"kubernetes.io/projected/cd840947-3699-4ae5-b1b7-7eda545c95fc-kube-api-access-s2wrs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:02.082292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.082112    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:02.082292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.082124    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd840947-3699-4ae5-b1b7-7eda545c95fc-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:02.082292 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.082137    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd840947-3699-4ae5-b1b7-7eda545c95fc-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:02.349251 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.349167    5967 generic.go:356] "Generic (PLEG): container finished" podID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerID="dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3" exitCode=0
Oct 30 22:26:02.349251 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.349210    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"
Oct 30 22:26:02.349520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.349250    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" event={"ID":"cd840947-3699-4ae5-b1b7-7eda545c95fc","Type":"ContainerDied","Data":"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"}
Oct 30 22:26:02.349520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.349294    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl" event={"ID":"cd840947-3699-4ae5-b1b7-7eda545c95fc","Type":"ContainerDied","Data":"db8947087a67e33896b3a448634b150a76b4029d7f595504f3a5c3c434bd2c8a"}
Oct 30 22:26:02.349520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.349317    5967 scope.go:122] "RemoveContainer" containerID="dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"
Oct 30 22:26:02.350649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.350626    5967 generic.go:356] "Generic (PLEG): container finished" podID="de8fb258-289f-4af8-bba0-77330ff92732" containerID="d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597" exitCode=0
Oct 30 22:26:02.350745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.350671    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" event={"ID":"de8fb258-289f-4af8-bba0-77330ff92732","Type":"ContainerDied","Data":"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"}
Oct 30 22:26:02.350745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.350706    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2" event={"ID":"de8fb258-289f-4af8-bba0-77330ff92732","Type":"ContainerDied","Data":"bd351b0d204be938c2b518a6f6f8e0a8cec7ed15282e785191b536be9c95d46e"}
Oct 30 22:26:02.350745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.350677    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"
Oct 30 22:26:02.358805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.358785    5967 scope.go:122] "RemoveContainer" containerID="dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"
Oct 30 22:26:02.359099 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:02.359079    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3\": container with ID starting with dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3 not found: ID does not exist" containerID="dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"
Oct 30 22:26:02.359147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.359108    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3"} err="failed to get container status \"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3\": rpc error: code = NotFound desc = could not find container \"dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3\": container with ID starting with dc6d5bbb684a8e4bb235318c42c26430f0658110dc5e84f6f178b6af8b8c12e3 not found: ID does not exist"
Oct 30 22:26:02.359147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.359124    5967 scope.go:122] "RemoveContainer" containerID="d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"
Oct 30 22:26:02.367532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.367515    5967 scope.go:122] "RemoveContainer" containerID="d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"
Oct 30 22:26:02.367793 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:02.367767    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597\": container with ID starting with d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597 not found: ID does not exist" containerID="d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"
Oct 30 22:26:02.367863 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.367805    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597"} err="failed to get container status \"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597\": rpc error: code = NotFound desc = could not find container \"d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597\": container with ID starting with d7e01cb49b356e134c14b053a8c9a8f5e49ff6f14c45ba6e747878f8ebc07597 not found: ID does not exist"
Oct 30 22:26:02.513874 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.513839    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:26:02.518809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.518786    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/premium-w5-a7b06b-kserve-7767cdc59f-54gg2"]
Oct 30 22:26:02.627724 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.627697    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 22:26:02.635117 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:02.635095    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-a7b06b/simulator-w5-a7b06b-kserve-c9d5996c8-w74wl"]
Oct 30 22:26:04.018007 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:04.017973    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" path="/var/lib/kubelet/pods/cd840947-3699-4ae5-b1b7-7eda545c95fc/volumes"
Oct 30 22:26:04.018442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:04.018427    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de8fb258-289f-4af8-bba0-77330ff92732" path="/var/lib/kubelet/pods/de8fb258-289f-4af8-bba0-77330ff92732/volumes"
Oct 30 22:26:04.653611 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:04.653577    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:26:04.653805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:04.653784    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy" containerID="cri-o://00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3" gracePeriod=30
Oct 30 22:26:05.594226 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:05.594191    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:26:05.603579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:05.603544    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:26:09.908970 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.908943    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:26:09.977413 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977381    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977445    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977502    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977525    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977566    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977626    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977669    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977763    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.977815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977796    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:09.978018 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977804    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:09.978018 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977829    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\") pod \"b28c6d7a-269a-4551-8231-b469743b4f76\" (UID: \"b28c6d7a-269a-4551-8231-b469743b4f76\") "
Oct 30 22:26:09.978018 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.977983    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:09.978177 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978017    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:09.978251 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978225    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:09.978458 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978431    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:09.978546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978461    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:09.978546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978477    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:09.978546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978490    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28c6d7a-269a-4551-8231-b469743b4f76-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:09.978546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.978504    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:09.979962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.979925    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:09.980384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.980335    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:09.980520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.980502    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:09.980564 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:09.980514    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br" pod "b28c6d7a-269a-4551-8231-b469743b4f76" (UID: "b28c6d7a-269a-4551-8231-b469743b4f76"). InnerVolumeSpecName "kube-api-access-4t2br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:10.079762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.079726    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28c6d7a-269a-4551-8231-b469743b4f76-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.079762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.079761    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.080060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.079774    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t2br\" (UniqueName: \"kubernetes.io/projected/b28c6d7a-269a-4551-8231-b469743b4f76-kube-api-access-4t2br\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.080060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.079788    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28c6d7a-269a-4551-8231-b469743b4f76-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.399776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.399688    5967 generic.go:356] "Generic (PLEG): container finished" podID="b28c6d7a-269a-4551-8231-b469743b4f76" containerID="00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3" exitCode=0
Oct 30 22:26:10.399776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.399735    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" event={"ID":"b28c6d7a-269a-4551-8231-b469743b4f76","Type":"ContainerDied","Data":"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"}
Oct 30 22:26:10.399776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.399740    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"
Oct 30 22:26:10.399776 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.399777    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9" event={"ID":"b28c6d7a-269a-4551-8231-b469743b4f76","Type":"ContainerDied","Data":"a88fdf971970dd97949c30dcc93314bdb01920a4e2ddd5e69708ca9c98743216"}
Oct 30 22:26:10.400118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.399800    5967 scope.go:122] "RemoveContainer" containerID="00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"
Oct 30 22:26:10.408313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.408284    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:26:10.408575 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.408549    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" containerID="cri-o://f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b" gracePeriod=30
Oct 30 22:26:10.410580 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.410555    5967 scope.go:122] "RemoveContainer" containerID="00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"
Oct 30 22:26:10.410887 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:10.410864    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3\": container with ID starting with 00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3 not found: ID does not exist" containerID="00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"
Oct 30 22:26:10.410962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.410898    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3"} err="failed to get container status \"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3\": rpc error: code = NotFound desc = could not find container \"00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3\": container with ID starting with 00cf1ba584b6a8bf8c8b60e30de3a895e356611467bd49c484d6c9cd6ed909e3 not found: ID does not exist"
Oct 30 22:26:10.688771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.688688    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:26:10.693162 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:10.693126    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-lktp9"]
Oct 30 22:26:12.018781 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.018747    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" path="/var/lib/kubelet/pods/b28c6d7a-269a-4551-8231-b469743b4f76/volumes"
Oct 30 22:26:12.538089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.538049    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:26:12.539011 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.538543    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" podUID="f5a57750-0947-41c7-8f72-dd678ec3307d" containerName="maas-api" containerID="cri-o://f31666208ae4c07c81da70aedf8ada5763a741adfff92b5ade03d1a15cd2ec48" gracePeriod=30
Oct 30 22:26:12.869567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.869539    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:26:12.914209 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914176    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\") pod \"f5a57750-0947-41c7-8f72-dd678ec3307d\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") "
Oct 30 22:26:12.914395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914227    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") pod \"f5a57750-0947-41c7-8f72-dd678ec3307d\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") "
Oct 30 22:26:12.914395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914273    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\") pod \"f5a57750-0947-41c7-8f72-dd678ec3307d\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") "
Oct 30 22:26:12.914395 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914300    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\" (UniqueName: \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\") pod \"f5a57750-0947-41c7-8f72-dd678ec3307d\" (UID: \"f5a57750-0947-41c7-8f72-dd678ec3307d\") "
Oct 30 22:26:12.914610 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914587    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca" pod "f5a57750-0947-41c7-8f72-dd678ec3307d" (UID: "f5a57750-0947-41c7-8f72-dd678ec3307d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:12.914881 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.914854    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a57750-0947-41c7-8f72-dd678ec3307d-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:12.916627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.916597    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d" pod "f5a57750-0947-41c7-8f72-dd678ec3307d" (UID: "f5a57750-0947-41c7-8f72-dd678ec3307d"). InnerVolumeSpecName "kube-api-access-8w62d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:12.917003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.916977    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs" pod "f5a57750-0947-41c7-8f72-dd678ec3307d" (UID: "f5a57750-0947-41c7-8f72-dd678ec3307d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:12.917069 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:12.917051    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls" pod "f5a57750-0947-41c7-8f72-dd678ec3307d" (UID: "f5a57750-0947-41c7-8f72-dd678ec3307d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:13.016323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.016282    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:13.016323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.016327    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5a57750-0947-41c7-8f72-dd678ec3307d-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:13.016583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.016345    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w62d\" (UniqueName: \"kubernetes.io/projected/f5a57750-0947-41c7-8f72-dd678ec3307d-kube-api-access-8w62d\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:13.273421 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.273393    5967 scope.go:122] "RemoveContainer" containerID="f31666208ae4c07c81da70aedf8ada5763a741adfff92b5ade03d1a15cd2ec48"
Oct 30 22:26:13.416450 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.416408    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" event={"ID":"f5a57750-0947-41c7-8f72-dd678ec3307d","Type":"ContainerDied","Data":"f31666208ae4c07c81da70aedf8ada5763a741adfff92b5ade03d1a15cd2ec48"}
Oct 30 22:26:13.416614 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.416498    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4" event={"ID":"f5a57750-0947-41c7-8f72-dd678ec3307d","Type":"ContainerDied","Data":"eaca16b4056e180fc4ef7516b761af7d1c57a51d5067b32fffb189164e251661"}
Oct 30 22:26:13.416614 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.416498    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"
Oct 30 22:26:13.497973 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.497939    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-nntxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:26:13.498131 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.498010    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:26:13.650913 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.650812    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:26:13.652741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:13.652719    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1024a-58c46c8474-qtkz4"]
Oct 30 22:26:14.017709 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:14.017675    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5a57750-0947-41c7-8f72-dd678ec3307d" path="/var/lib/kubelet/pods/f5a57750-0947-41c7-8f72-dd678ec3307d/volumes"
Oct 30 22:26:15.603935 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.603900    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:26:15.678864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.678795    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:26:15.751462 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751429    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751486    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751523    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751560    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751587    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751635 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751616    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751710    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751731    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:15.751904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751822    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751855    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\") pod \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\" (UID: \"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd\") "
Oct 30 22:26:15.751904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.751866    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:15.752161 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752008    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:15.752237 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752213    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:15.752304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752240    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:15.752538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752431    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.752538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752457    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.752538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752473    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.752538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752486    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.752538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.752501    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.754100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.754074    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "kube-api-access-bzt6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:15.754181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.754110    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:15.754181 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.754113    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:15.754325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.754308    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token" pod "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" (UID: "71ec1f86-96ca-4ac6-adb6-e3c6d04889bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:15.853728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.853701    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.853728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.853727    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzt6k\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-kube-api-access-bzt6k\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.853728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.853737    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:15.853728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:15.853747    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:16.435142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.435063    5967 generic.go:356] "Generic (PLEG): container finished" podID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerID="f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b" exitCode=0
Oct 30 22:26:16.435142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.435112    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"
Oct 30 22:26:16.435350 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.435112    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" event={"ID":"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd","Type":"ContainerDied","Data":"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"}
Oct 30 22:26:16.435350 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.435240    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm" event={"ID":"71ec1f86-96ca-4ac6-adb6-e3c6d04889bd","Type":"ContainerDied","Data":"2601ab3ac1183d8d1024ca62ebddf70173b072390974c27034b3dbc5862785be"}
Oct 30 22:26:16.435350 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.435268    5967 scope.go:122] "RemoveContainer" containerID="f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"
Oct 30 22:26:16.444583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.444561    5967 scope.go:122] "RemoveContainer" containerID="f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"
Oct 30 22:26:16.444890 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:16.444868    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b\": container with ID starting with f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b not found: ID does not exist" containerID="f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"
Oct 30 22:26:16.444963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.444902    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b"} err="failed to get container status \"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b\": rpc error: code = NotFound desc = could not find container \"f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b\": container with ID starting with f4c5469c0e430df1ae210bad40100859b0ba1aa2a7ee29434afa59dff3e1214b not found: ID does not exist"
Oct 30 22:26:16.654916 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.654882    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:26:16.704650 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:16.704580    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-nntxm"]
Oct 30 22:26:17.442921 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.442892    5967 generic.go:356] "Generic (PLEG): container finished" podID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerID="8126059cc6559d6d84f83ba02a3df86c3b63ad4454a813844c66d899dfcddc56" exitCode=0
Oct 30 22:26:17.443055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.442960    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" event={"ID":"81060fd5-e321-44fd-8e11-c2dc2392ad20","Type":"ContainerDied","Data":"8126059cc6559d6d84f83ba02a3df86c3b63ad4454a813844c66d899dfcddc56"}
Oct 30 22:26:17.589848 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.589777    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 22:26:17.677730 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.677692    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\" (UniqueName: \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\") pod \"81060fd5-e321-44fd-8e11-c2dc2392ad20\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") "
Oct 30 22:26:17.678223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.677915    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\") pod \"81060fd5-e321-44fd-8e11-c2dc2392ad20\" (UID: \"81060fd5-e321-44fd-8e11-c2dc2392ad20\") "
Oct 30 22:26:17.678283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.678239    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume" pod "81060fd5-e321-44fd-8e11-c2dc2392ad20" (UID: "81060fd5-e321-44fd-8e11-c2dc2392ad20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:17.678506 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.678487    5967 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81060fd5-e321-44fd-8e11-c2dc2392ad20-plugins-config-volume\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:17.680146 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.680127    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7" pod "81060fd5-e321-44fd-8e11-c2dc2392ad20" (UID: "81060fd5-e321-44fd-8e11-c2dc2392ad20"). InnerVolumeSpecName "kube-api-access-plkf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:17.780286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:17.780250    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plkf7\" (UniqueName: \"kubernetes.io/projected/81060fd5-e321-44fd-8e11-c2dc2392ad20-kube-api-access-plkf7\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:18.018280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.018246    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" path="/var/lib/kubelet/pods/71ec1f86-96ca-4ac6-adb6-e3c6d04889bd/volumes"
Oct 30 22:26:18.451435 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.451347    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7" event={"ID":"81060fd5-e321-44fd-8e11-c2dc2392ad20","Type":"ContainerDied","Data":"3579b5aac4220526f0cb6b4103ce1072ce5c98a27e37133dba16f9debdd00d66"}
Oct 30 22:26:18.451435 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.451401    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"
Oct 30 22:26:18.451652 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.451441    5967 scope.go:122] "RemoveContainer" containerID="8126059cc6559d6d84f83ba02a3df86c3b63ad4454a813844c66d899dfcddc56"
Oct 30 22:26:18.616900 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.616865    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 22:26:18.666032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:18.665998    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-a7b06b-8478bc4b9-4cxr7"]
Oct 30 22:26:20.020535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:20.020486    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" path="/var/lib/kubelet/pods/81060fd5-e321-44fd-8e11-c2dc2392ad20/volumes"
Oct 30 22:26:24.472753 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:24.472714    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:26:24.473165 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:24.472971    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy" containerID="cri-o://248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59" gracePeriod=30
Oct 30 22:26:29.742449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.742361    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:26:29.844284 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844244    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844296    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844345    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844434    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844464    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844664 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844516    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844664 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844607    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844664 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844647    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.844810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844680    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.844810 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844711    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\") pod \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\" (UID: \"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45\") "
Oct 30 22:26:29.845287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844783    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.845287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844876    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.845287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.844915    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:29.845738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.845134    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.845738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.845143    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.846723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.846702    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "kube-api-access-m9gfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.846858 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.846814    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.846933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.846885    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:29.847362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.847334    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token" pod "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" (UID: "0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.947226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947173    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947213    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947228    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947242    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947257    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947272    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947286    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.947589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:29.947300    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9gfd\" (UniqueName: \"kubernetes.io/projected/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45-kube-api-access-m9gfd\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:30.523553 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.523513    5967 generic.go:356] "Generic (PLEG): container finished" podID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerID="248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59" exitCode=0
Oct 30 22:26:30.523712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.523556    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"
Oct 30 22:26:30.523712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.523587    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" event={"ID":"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45","Type":"ContainerDied","Data":"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"}
Oct 30 22:26:30.523712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.523641    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m" event={"ID":"0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45","Type":"ContainerDied","Data":"0221eb876df852cd1af482f9bbfd1eb6a242e3ca18421e52be54075b76150242"}
Oct 30 22:26:30.523712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.523663    5967 scope.go:122] "RemoveContainer" containerID="248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"
Oct 30 22:26:30.533027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.533008    5967 scope.go:122] "RemoveContainer" containerID="248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"
Oct 30 22:26:30.533314 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:30.533295    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59\": container with ID starting with 248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59 not found: ID does not exist" containerID="248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"
Oct 30 22:26:30.533424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.533326    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59"} err="failed to get container status \"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59\": rpc error: code = NotFound desc = could not find container \"248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59\": container with ID starting with 248982aefe51221597f8efadb7023cb92309acdf9e3be25557e066a8de60cd59 not found: ID does not exist"
Oct 30 22:26:30.690144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.690111    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:26:30.694474 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:30.694452    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-hqn2m"]
Oct 30 22:26:32.018922 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:32.018889    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" path="/var/lib/kubelet/pods/0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45/volumes"
Oct 30 22:26:35.591853 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:35.591819    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:26:50.711806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:50.711765    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:26:50.712454 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:50.712008    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" containerID="cri-o://d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678" gracePeriod=30
Oct 30 22:26:51.394080 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:51.393998    5967 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:26:51.394301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:51.394083    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:26:55.985831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:55.985766    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:26:56.064089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064051    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064101    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064194    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064250    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064283    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064329    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064346    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:56.064618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064495    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064522    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:56.064618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064534    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064626    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:56.064875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064656    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\") pod \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\" (UID: \"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec\") "
Oct 30 22:26:56.064875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064694    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:56.064875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.064752    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:56.065268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.065127    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.065268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.065146    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.065268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.065157    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.065268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.065166    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.065268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.065176    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.066654 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.066626    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:56.066795 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.066775    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "kube-api-access-ckx8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:56.067202 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.067178    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:56.067202 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.067196    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token" pod "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" (UID: "2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:56.166324 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.166287    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.166324 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.166319    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckx8g\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-kube-api-access-ckx8g\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.166541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.166335    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.166541 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.166347    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.693608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.691212    5967 generic.go:356] "Generic (PLEG): container finished" podID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerID="d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678" exitCode=0
Oct 30 22:26:56.693608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.691361    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" event={"ID":"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec","Type":"ContainerDied","Data":"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"}
Oct 30 22:26:56.693608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.691503    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t" event={"ID":"2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec","Type":"ContainerDied","Data":"25922652291f49f9a34f16ff64eb417f2ed64c53821d811aee2fd9fc9b1373ec"}
Oct 30 22:26:56.693608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.691533    5967 scope.go:122] "RemoveContainer" containerID="d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"
Oct 30 22:26:56.693608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.691750    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"
Oct 30 22:26:56.704227 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.704210    5967 scope.go:122] "RemoveContainer" containerID="d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"
Oct 30 22:26:56.704532 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:26:56.704511    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678\": container with ID starting with d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678 not found: ID does not exist" containerID="d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"
Oct 30 22:26:56.704614 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.704541    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678"} err="failed to get container status \"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678\": rpc error: code = NotFound desc = could not find container \"d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678\": container with ID starting with d566133164931d0a83e711446816afb262a6040fc8b63b066da2b5045711f678 not found: ID does not exist"
Oct 30 22:26:56.910252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.910218    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:26:56.959385 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:56.959299    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-6pl7t"]
Oct 30 22:26:58.018294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:26:58.018256    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" path="/var/lib/kubelet/pods/2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec/volumes"
Oct 30 22:27:05.592768 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:27:05.592729    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:27:27.696906 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:27.696867    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:27:27.697475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:27.697100    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy" containerID="cri-o://9150c08ef86fb3035dee0239cd8ea06f669cbfa0b38f5e82cb83fc038e3d074e" gracePeriod=30
Oct 30 22:27:32.892361 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:32.892329    5967 generic.go:356] "Generic (PLEG): container finished" podID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerID="9150c08ef86fb3035dee0239cd8ea06f669cbfa0b38f5e82cb83fc038e3d074e" exitCode=0
Oct 30 22:27:32.892771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:32.892407    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" event={"ID":"f911f710-3519-4eb1-844e-43ebca4a9a6c","Type":"ContainerDied","Data":"9150c08ef86fb3035dee0239cd8ea06f669cbfa0b38f5e82cb83fc038e3d074e"}
Oct 30 22:27:32.965917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:32.965892    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:27:33.082028 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.081999    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082130    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082204 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082191    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082307    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:33.082401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082321    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082417    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082454    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:33.082510 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082486    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082529    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082620 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082571    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082636    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\") pod \"f911f710-3519-4eb1-844e-43ebca4a9a6c\" (UID: \"f911f710-3519-4eb1-844e-43ebca4a9a6c\") "
Oct 30 22:27:33.082723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082647    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:33.083184 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.082923    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:33.083184 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083104    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:33.083401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083238    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f911f710-3519-4eb1-844e-43ebca4a9a6c-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.083401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083257    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.083401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083270    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.083401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083284    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.083401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.083296    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.084931 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.084901    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:27:33.085044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.084990    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:33.085242 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.085226    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "kube-api-access-mvws2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:33.085351 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.085330    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy" pod "f911f710-3519-4eb1-844e-43ebca4a9a6c" (UID: "f911f710-3519-4eb1-844e-43ebca4a9a6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:33.184723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.184692    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.184723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.184718    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.184723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.184728    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvws2\" (UniqueName: \"kubernetes.io/projected/f911f710-3519-4eb1-844e-43ebca4a9a6c-kube-api-access-mvws2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.184947 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.184737    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f911f710-3519-4eb1-844e-43ebca4a9a6c-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:33.899286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.899247    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds" event={"ID":"f911f710-3519-4eb1-844e-43ebca4a9a6c","Type":"ContainerDied","Data":"e1fbbd8fb669fecdf315f6fd1f22cedc6dc771fb050e7fd469ce442f80cd69d7"}
Oct 30 22:27:33.899738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.899300    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"
Oct 30 22:27:33.899738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:33.899329    5967 scope.go:122] "RemoveContainer" containerID="9150c08ef86fb3035dee0239cd8ea06f669cbfa0b38f5e82cb83fc038e3d074e"
Oct 30 22:27:34.114149 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:34.114108    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:27:34.116730 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:34.116704    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-j2sds"]
Oct 30 22:27:35.592355 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:27:35.592321    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:27:36.017845 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:36.017812    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" path="/var/lib/kubelet/pods/f911f710-3519-4eb1-844e-43ebca4a9a6c/volumes"
Oct 30 22:27:39.358095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:39.358060    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:27:39.358586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:39.358270    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy" containerID="cri-o://97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592" gracePeriod=30
Oct 30 22:27:44.621908 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.621881    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715684    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715737    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715775    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715869    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715932    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.715974    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.716047    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.716075    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717035 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.716153    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\") pod \"c4b10444-8016-498c-9431-6048a2fc812b\" (UID: \"c4b10444-8016-498c-9431-6048a2fc812b\") "
Oct 30 22:27:44.717875 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.717843    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:44.718010 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.717994    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:44.718302 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.718282    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:44.718535 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.718506    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:44.718689 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.718571    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:44.719651 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.719611    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:27:44.720178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.720157    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "kube-api-access-sk64r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:44.720745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.720720    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:44.720745 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.720733    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token" pod "c4b10444-8016-498c-9431-6048a2fc812b" (UID: "c4b10444-8016-498c-9431-6048a2fc812b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:44.817963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817930    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b10444-8016-498c-9431-6048a2fc812b-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.817963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817959    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.817963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817968    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817978    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk64r\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-kube-api-access-sk64r\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817988    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b10444-8016-498c-9431-6048a2fc812b-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.817997    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.818004    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.818013    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b10444-8016-498c-9431-6048a2fc812b-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.818255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.818021    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b10444-8016-498c-9431-6048a2fc812b-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:44.885638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.885601    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:27:44.894519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.894477    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 22:27:44.970587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.970503    5967 generic.go:356] "Generic (PLEG): container finished" podID="c4b10444-8016-498c-9431-6048a2fc812b" containerID="97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592" exitCode=0
Oct 30 22:27:44.970587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.970562    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"
Oct 30 22:27:44.970819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.970593    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerDied","Data":"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"}
Oct 30 22:27:44.970819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.970662    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b" event={"ID":"c4b10444-8016-498c-9431-6048a2fc812b","Type":"ContainerDied","Data":"f8907ba0aaa9eeeda93eb48f29f6922fb7f5eb41ab69d49955fac00b3365a136"}
Oct 30 22:27:44.970819 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.970690    5967 scope.go:122] "RemoveContainer" containerID="97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"
Oct 30 22:27:44.981141 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.981121    5967 scope.go:122] "RemoveContainer" containerID="ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"
Oct 30 22:27:44.991343 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.991325    5967 scope.go:122] "RemoveContainer" containerID="97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"
Oct 30 22:27:44.991621 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:27:44.991602    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592\": container with ID starting with 97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592 not found: ID does not exist" containerID="97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"
Oct 30 22:27:44.991679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.991630    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592"} err="failed to get container status \"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592\": rpc error: code = NotFound desc = could not find container \"97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592\": container with ID starting with 97f42b7e09fdc1196b585696b3d9fd673722a7172b87841596f73701d877b592 not found: ID does not exist"
Oct 30 22:27:44.991679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.991648    5967 scope.go:122] "RemoveContainer" containerID="ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"
Oct 30 22:27:44.991865 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:27:44.991847    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4\": container with ID starting with ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4 not found: ID does not exist" containerID="ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"
Oct 30 22:27:44.991923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:44.991876    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4"} err="failed to get container status \"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4\": rpc error: code = NotFound desc = could not find container \"ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4\": container with ID starting with ac47309f73034b83bf5c3132e32512d7726de1a507befdff6eb17da049d163e4 not found: ID does not exist"
Oct 30 22:27:45.228593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:45.228524    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:27:45.233469 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:45.233438    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-67657a-openshift-default-74f47c4b47-nnz5b"]
Oct 30 22:27:46.018250 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:46.018216    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4b10444-8016-498c-9431-6048a2fc812b" path="/var/lib/kubelet/pods/c4b10444-8016-498c-9431-6048a2fc812b/volumes"
Oct 30 22:27:59.907339 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:59.907300    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" containerID="cri-o://dc6a884ef5d9cd1b2db099bc94a1f1bb065b7c287dcda6102dfb9249a0463371" gracePeriod=45
Oct 30 22:27:59.915040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:27:59.915006    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" containerID="cri-o://af059e378c1e92f5ea40b9cccdb90442b7bdc82694de5ef54d6a140c1c7e8c3c" gracePeriod=45
Oct 30 22:28:00.051693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.051640    5967 generic.go:356] "Generic (PLEG): container finished" podID="058475ce-5615-4507-a424-77778ae19f84" containerID="af059e378c1e92f5ea40b9cccdb90442b7bdc82694de5ef54d6a140c1c7e8c3c" exitCode=0
Oct 30 22:28:00.051882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.051823    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" event={"ID":"058475ce-5615-4507-a424-77778ae19f84","Type":"ContainerDied","Data":"af059e378c1e92f5ea40b9cccdb90442b7bdc82694de5ef54d6a140c1c7e8c3c"}
Oct 30 22:28:00.054203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.054168    5967 generic.go:356] "Generic (PLEG): container finished" podID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerID="dc6a884ef5d9cd1b2db099bc94a1f1bb065b7c287dcda6102dfb9249a0463371" exitCode=0
Oct 30 22:28:00.054403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.054245    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" event={"ID":"470ec18e-a5d8-4048-94d9-2d01d26a1866","Type":"ContainerDied","Data":"dc6a884ef5d9cd1b2db099bc94a1f1bb065b7c287dcda6102dfb9249a0463371"}
Oct 30 22:28:00.193252 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.193227    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:28:00.198938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.198915    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:28:00.287073 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287041    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287106    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\" (UniqueName: \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287153    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\" (UniqueName: \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.287271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287182    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287214    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287271 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287240    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287274    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287305    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\" (UniqueName: \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287339    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287400    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287424    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287491    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\" (UniqueName: \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\") pod \"470ec18e-a5d8-4048-94d9-2d01d26a1866\" (UID: \"470ec18e-a5d8-4048-94d9-2d01d26a1866\") "
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287505    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.287589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287523    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\") pod \"058475ce-5615-4507-a424-77778ae19f84\" (UID: \"058475ce-5615-4507-a424-77778ae19f84\") "
Oct 30 22:28:00.288003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287669    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.288003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287872    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.288003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.287905    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288063    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288072    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288104    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288121    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288135    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.288327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.288149    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.290020 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.289995    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "kube-api-access-fnhsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:00.290172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.290105    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.290223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.290171    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.290223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.290169    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "kube-api-access-48qwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:00.290223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.290198    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs" pod "470ec18e-a5d8-4048-94d9-2d01d26a1866" (UID: "470ec18e-a5d8-4048-94d9-2d01d26a1866"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:00.290223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.290200    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs" pod "058475ce-5615-4507-a424-77778ae19f84" (UID: "058475ce-5615-4507-a424-77778ae19f84"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:00.389700 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389672    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48qwc\" (UniqueName: \"kubernetes.io/projected/470ec18e-a5d8-4048-94d9-2d01d26a1866-kube-api-access-48qwc\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389700 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389699    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058475ce-5615-4507-a424-77778ae19f84-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389709    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ec18e-a5d8-4048-94d9-2d01d26a1866-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389718    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnhsx\" (UniqueName: \"kubernetes.io/projected/058475ce-5615-4507-a424-77778ae19f84-kube-api-access-fnhsx\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389732    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389744    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058475ce-5615-4507-a424-77778ae19f84-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.389903 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:00.389752    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ec18e-a5d8-4048-94d9-2d01d26a1866-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:01.060999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.060963    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"
Oct 30 22:28:01.060999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.060997    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" event={"ID":"470ec18e-a5d8-4048-94d9-2d01d26a1866","Type":"ContainerDied","Data":"135aeaf789f056a04e1b65a51e9393d84710ab5a3b2a7c1c8da7da2c6c684db9"}
Oct 30 22:28:01.061581 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.061041    5967 scope.go:122] "RemoveContainer" containerID="dc6a884ef5d9cd1b2db099bc94a1f1bb065b7c287dcda6102dfb9249a0463371"
Oct 30 22:28:01.062694 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.062667    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" event={"ID":"058475ce-5615-4507-a424-77778ae19f84","Type":"ContainerDied","Data":"19dd7e2d0fdbe836fc8017dee98dcb457c63cc2d1e4a261919ab7dd6462f0bdf"}
Oct 30 22:28:01.062882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.062865    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"
Oct 30 22:28:01.077501 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.077482    5967 scope.go:122] "RemoveContainer" containerID="af059e378c1e92f5ea40b9cccdb90442b7bdc82694de5ef54d6a140c1c7e8c3c"
Oct 30 22:28:01.111638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.111585    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:28:01.169138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.169076    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Oct 30 22:28:01.227182 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.227149    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 22:28:01.276907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.276875    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/simulator-w2-b2f165-kserve-bf67596d5-6pvpx"]
Oct 30 22:28:01.386691 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.386661    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:28:01.391197 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:01.391172    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/premium-w2-b2f165-kserve-58465fd95b-lnd9p"]
Oct 30 22:28:02.017265 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:02.017236    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="058475ce-5615-4507-a424-77778ae19f84" path="/var/lib/kubelet/pods/058475ce-5615-4507-a424-77778ae19f84/volumes"
Oct 30 22:28:02.017695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:02.017680    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" path="/var/lib/kubelet/pods/470ec18e-a5d8-4048-94d9-2d01d26a1866/volumes"
Oct 30 22:28:05.591770 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:28:05.591724    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:28:07.469209 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.469172    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"]
Oct 30 22:28:07.469866 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.469842    5967 cpu_manager.go:414] "containerMap: removing container" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main"
Oct 30 22:28:07.470032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470009    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470040    5967 cpu_manager.go:414] "containerMap: removing container" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470046    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470058    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470062    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470073    5967 cpu_manager.go:414] "containerMap: removing container" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470077    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470084    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d9b011fb-a656-4889-8d95-71adabe71a51" containerName="maas-api"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470088    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9b011fb-a656-4889-8d95-71adabe71a51" containerName="maas-api"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470095    5967 cpu_manager.go:414] "containerMap: removing container" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470099    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470113    5967 cpu_manager.go:414] "containerMap: removing container" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470119    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470127    5967 cpu_manager.go:414] "containerMap: removing container" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470133    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main"
Oct 30 22:28:07.470138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470143    5967 cpu_manager.go:414] "containerMap: removing container" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470147    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470155    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470160    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470170    5967 cpu_manager.go:414] "containerMap: removing container" podUID="f5a57750-0947-41c7-8f72-dd678ec3307d" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470176    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5a57750-0947-41c7-8f72-dd678ec3307d" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470186    5967 cpu_manager.go:414] "containerMap: removing container" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470191    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470198    5967 cpu_manager.go:414] "containerMap: removing container" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470202    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470210    5967 cpu_manager.go:414] "containerMap: removing container" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470214    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470232    5967 cpu_manager.go:414] "containerMap: removing container" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470236    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470249    5967 cpu_manager.go:414] "containerMap: removing container" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470253    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470260    5967 cpu_manager.go:414] "containerMap: removing container" podUID="27027312-9922-439f-926d-14ca281f4ab5" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470265    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27027312-9922-439f-926d-14ca281f4ab5" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470347    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="81060fd5-e321-44fd-8e11-c2dc2392ad20" containerName="payload-processing"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470357    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="27027312-9922-439f-926d-14ca281f4ab5" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470364    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="eedca670-799e-4929-95cc-2661490cca66" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470388    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="de8fb258-289f-4af8-bba0-77330ff92732" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470396    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470402    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f9d86bf-c0ee-477a-b1c0-b1d31b6e4e45" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470407    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9b011fb-a656-4889-8d95-71adabe71a51" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470412    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="470ec18e-a5d8-4048-94d9-2d01d26a1866" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470418    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="38055ab8-0c2f-483a-ad13-4502b10326cb" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470423    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd840947-3699-4ae5-b1b7-7eda545c95fc" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470429    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="f911f710-3519-4eb1-844e-43ebca4a9a6c" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470435    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2308488f-4fe6-47f0-b6fb-d1e0d0d6d3ec" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470440    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5a57750-0947-41c7-8f72-dd678ec3307d" containerName="maas-api"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470445    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4b10444-8016-498c-9431-6048a2fc812b" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470450    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="b28c6d7a-269a-4551-8231-b469743b4f76" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470456    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="71ec1f86-96ca-4ac6-adb6-e3c6d04889bd" containerName="istio-proxy"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470463    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="058475ce-5615-4507-a424-77778ae19f84" containerName="main"
Oct 30 22:28:07.470738 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.470468    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aed3651-9994-43c9-9465-18ab7cde4a56" containerName="maas-api"
Oct 30 22:28:07.475363 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.475344    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.530720 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.530688    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"]
Oct 30 22:28:07.566048 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.566021    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.566174 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.566071    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72xw\" (UniqueName: \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.566229 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.566180    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.577656 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.577629    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:28:07.577806 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.577789    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:28:07.667051 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.667015    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.667232 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.667079    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f72xw\" (UniqueName: \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.667232 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.667152    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.667791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.667767    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.669524 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.669500    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.727823 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.727757    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72xw\" (UniqueName: \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\") pod \"maas-api-revoke-sub-a12bd7fc-8t8bf\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:07.792741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:07.792714    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:08.166051 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:08.166005    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"]
Oct 30 22:28:08.168418 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:28:08.168389    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fcaebe_ccaa_4879_a83a_a4196f6adb61.slice/crio-4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed WatchSource:0}: Error finding container 4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed: Status 404 returned error can't find the container with id 4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed
Oct 30 22:28:09.108711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:09.108652    5967 generic.go:356] "Generic (PLEG): container finished" podID="53fcaebe-ccaa-4879-a83a-a4196f6adb61" containerID="4338900040b9425023de9fa9af428649d128070bdcf13b51642418235a85a28c" exitCode=0
Oct 30 22:28:09.109262 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:09.108790    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf" event={"ID":"53fcaebe-ccaa-4879-a83a-a4196f6adb61","Type":"ContainerDied","Data":"4338900040b9425023de9fa9af428649d128070bdcf13b51642418235a85a28c"}
Oct 30 22:28:09.109262 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:09.108900    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf" event={"ID":"53fcaebe-ccaa-4879-a83a-a4196f6adb61","Type":"ContainerStarted","Data":"4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed"}
Oct 30 22:28:10.260719 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.260695    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:10.398171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.398098    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\" (UniqueName: \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\") pod \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") "
Oct 30 22:28:10.398171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.398153    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\") pod \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") "
Oct 30 22:28:10.398402 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.398196    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\") pod \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\" (UID: \"53fcaebe-ccaa-4879-a83a-a4196f6adb61\") "
Oct 30 22:28:10.398646 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.398615    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca" pod "53fcaebe-ccaa-4879-a83a-a4196f6adb61" (UID: "53fcaebe-ccaa-4879-a83a-a4196f6adb61"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:10.400702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.400675    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca" pod "53fcaebe-ccaa-4879-a83a-a4196f6adb61" (UID: "53fcaebe-ccaa-4879-a83a-a4196f6adb61"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:10.400904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.400885    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw" pod "53fcaebe-ccaa-4879-a83a-a4196f6adb61" (UID: "53fcaebe-ccaa-4879-a83a-a4196f6adb61"). InnerVolumeSpecName "kube-api-access-f72xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:10.500140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.500091    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f72xw\" (UniqueName: \"kubernetes.io/projected/53fcaebe-ccaa-4879-a83a-a4196f6adb61-kube-api-access-f72xw\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:10.500140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.500130    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:10.500140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:10.500145    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53fcaebe-ccaa-4879-a83a-a4196f6adb61-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:11.120598 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:11.120559    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf" event={"ID":"53fcaebe-ccaa-4879-a83a-a4196f6adb61","Type":"ContainerDied","Data":"4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed"}
Oct 30 22:28:11.120753 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:11.120617    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ec1b298e8e8db67917b5880cf4cb24ba9ed1a4bc3dd63e57343538f21e233ed"
Oct 30 22:28:11.120753 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:11.120568    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"
Oct 30 22:28:12.629291 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.629259    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"]
Oct 30 22:28:12.629933 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.629914    5967 cpu_manager.go:414] "containerMap: removing container" podUID="53fcaebe-ccaa-4879-a83a-a4196f6adb61" containerName="revoke-keys"
Oct 30 22:28:12.630039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.629937    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53fcaebe-ccaa-4879-a83a-a4196f6adb61" containerName="revoke-keys"
Oct 30 22:28:12.630100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.630051    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="53fcaebe-ccaa-4879-a83a-a4196f6adb61" containerName="revoke-keys"
Oct 30 22:28:12.633323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.633304    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.691062 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.691029    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"]
Oct 30 22:28:12.722814 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.722786    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.722997 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.722833    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.722997 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.722980    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4dh\" (UniqueName: \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.734955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.734931    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:28:12.735085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.735006    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:28:12.823740 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.823709    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.823860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.823758    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.823860 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.823816    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4dh\" (UniqueName: \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.824398 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.824355    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.826274 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.826253    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.885171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.885100    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4dh\" (UniqueName: \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\") pod \"maas-api-revoke-sub-01fa7403-gqk4m\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:12.946850 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:12.946816    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:13.322270 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:13.322240    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"]
Oct 30 22:28:13.324968 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:28:13.324940    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589af8b9_3fa3_4b07_8ffe_611efc680aa3.slice/crio-ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e WatchSource:0}: Error finding container ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e: Status 404 returned error can't find the container with id ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e
Oct 30 22:28:14.138064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:14.138028    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m" event={"ID":"589af8b9-3fa3-4b07-8ffe-611efc680aa3","Type":"ContainerStarted","Data":"55f03fa94b812a27c1185967bc7fe3b1073ecc214d2051f1e2c2231340e71414"}
Oct 30 22:28:14.138575 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:14.138083    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m" event={"ID":"589af8b9-3fa3-4b07-8ffe-611efc680aa3","Type":"ContainerStarted","Data":"ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e"}
Oct 30 22:28:14.254958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:14.254906    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m" podStartSLOduration=2.254888436 podStartE2EDuration="2.254888436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:14.253924835 +0000 UTC m=+2582.368633238" watchObservedRunningTime="2026-10-30 22:28:14.254888436 +0000 UTC m=+2582.369596791"
Oct 30 22:28:15.145135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:15.145100    5967 generic.go:356] "Generic (PLEG): container finished" podID="589af8b9-3fa3-4b07-8ffe-611efc680aa3" containerID="55f03fa94b812a27c1185967bc7fe3b1073ecc214d2051f1e2c2231340e71414" exitCode=0
Oct 30 22:28:15.145552 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:15.145183    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m" event={"ID":"589af8b9-3fa3-4b07-8ffe-611efc680aa3","Type":"ContainerDied","Data":"55f03fa94b812a27c1185967bc7fe3b1073ecc214d2051f1e2c2231340e71414"}
Oct 30 22:28:16.288109 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.288087    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:16.470868 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.470839    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\") pod \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") "
Oct 30 22:28:16.471043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.470914    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\" (UniqueName: \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\") pod \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") "
Oct 30 22:28:16.471043 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.471019    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\") pod \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\" (UID: \"589af8b9-3fa3-4b07-8ffe-611efc680aa3\") "
Oct 30 22:28:16.471283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.471259    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca" pod "589af8b9-3fa3-4b07-8ffe-611efc680aa3" (UID: "589af8b9-3fa3-4b07-8ffe-611efc680aa3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:16.471481 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.471459    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:16.473313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.473284    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh" pod "589af8b9-3fa3-4b07-8ffe-611efc680aa3" (UID: "589af8b9-3fa3-4b07-8ffe-611efc680aa3"). InnerVolumeSpecName "kube-api-access-ks4dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:16.473313 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.473305    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca" pod "589af8b9-3fa3-4b07-8ffe-611efc680aa3" (UID: "589af8b9-3fa3-4b07-8ffe-611efc680aa3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:16.572304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.572274    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/589af8b9-3fa3-4b07-8ffe-611efc680aa3-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:16.572304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:16.572301    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks4dh\" (UniqueName: \"kubernetes.io/projected/589af8b9-3fa3-4b07-8ffe-611efc680aa3-kube-api-access-ks4dh\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:17.156825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:17.156800    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"
Oct 30 22:28:17.156825 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:17.156805    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m" event={"ID":"589af8b9-3fa3-4b07-8ffe-611efc680aa3","Type":"ContainerDied","Data":"ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e"}
Oct 30 22:28:17.157031 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:17.156854    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecbc8f39b184ff354ec05ddd0cee6571792f041daca7f88340002b88b893b15e"
Oct 30 22:28:35.596289 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:28:35.596251    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:28:54.315679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.315598    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 22:28:54.316078 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.315860    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" podUID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" containerName="maas-api" containerID="cri-o://a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1" gracePeriod=30
Oct 30 22:28:54.631959 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.631932    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 22:28:54.679276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679244    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") pod \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") "
Oct 30 22:28:54.679467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679287    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\") pod \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") "
Oct 30 22:28:54.679467 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679439    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\" (UniqueName: \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\") pod \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") "
Oct 30 22:28:54.679568 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679549    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\") pod \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\" (UID: \"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1\") "
Oct 30 22:28:54.679883 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679859    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca" pod "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" (UID: "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:54.680142 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.679961    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:54.681606 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.681581    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls" pod "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" (UID: "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:54.681698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.681638    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs" pod "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" (UID: "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:54.681698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.681641    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c" pod "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" (UID: "3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1"). InnerVolumeSpecName "kube-api-access-h989c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:54.781137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.781097    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:54.781137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.781124    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:54.781137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:54.781134    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h989c\" (UniqueName: \"kubernetes.io/projected/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1-kube-api-access-h989c\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:55.356741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.356707    5967 generic.go:356] "Generic (PLEG): container finished" podID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" containerID="a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1" exitCode=0
Oct 30 22:28:55.357148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.356750    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"
Oct 30 22:28:55.357148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.356790    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" event={"ID":"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1","Type":"ContainerDied","Data":"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"}
Oct 30 22:28:55.357148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.356844    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq" event={"ID":"3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1","Type":"ContainerDied","Data":"45fe2bb7601a4355b32d0603ade05a339a0299f17e6095270b0141f4308d951e"}
Oct 30 22:28:55.357148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.356875    5967 scope.go:122] "RemoveContainer" containerID="a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"
Oct 30 22:28:55.367310 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.367294    5967 scope.go:122] "RemoveContainer" containerID="a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"
Oct 30 22:28:55.367849 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:28:55.367592    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1\": container with ID starting with a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1 not found: ID does not exist" containerID="a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"
Oct 30 22:28:55.367849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.367619    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1"} err="failed to get container status \"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1\": rpc error: code = NotFound desc = could not find container \"a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1\": container with ID starting with a35fa9eda57faacf94bf3bb781ab8626c8e620632b1aa3cb148f2e54dc1e0af1 not found: ID does not exist"
Oct 30 22:28:55.524955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.524925    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 22:28:55.528193 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:55.528169    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7df73b-59cff77dbd-zhvmq"]
Oct 30 22:28:56.018162 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:28:56.018129    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" path="/var/lib/kubelet/pods/3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1/volumes"
Oct 30 22:29:04.448156 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:04.448123    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:29:04.448615 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:04.448334    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" containerID="cri-o://f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096" gracePeriod=30
Oct 30 22:29:05.601728 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:29:05.601685    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:29:07.899677 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:07.899643    5967 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:29:07.900144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:07.899734    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:29:09.705173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.705146    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:29:09.852655 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852624    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.852856 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852721    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.852856 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852749    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.852856 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852825    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852928    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.853044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852946    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.852975    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853002    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853031    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.853289 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853040    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853289 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853102    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.853289 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853184    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\") pod \"ffa163a9-849a-4820-990a-b8d1e42d1faa\" (UID: \"ffa163a9-849a-4820-990a-b8d1e42d1faa\") "
Oct 30 22:29:09.853539 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853354    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.853539 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853359    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:09.853756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853699    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.853756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853723    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.853756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853736    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.853756 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853754    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa163a9-849a-4820-990a-b8d1e42d1faa-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.853937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.853768    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.855282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.855264    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:09.855346 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.855329    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "kube-api-access-mpb9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:09.855667 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.855645    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.855667 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.855656    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo" pod "ffa163a9-849a-4820-990a-b8d1e42d1faa" (UID: "ffa163a9-849a-4820-990a-b8d1e42d1faa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:09.955401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.955324    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpb9c\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-kube-api-access-mpb9c\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.955401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.955360    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.955401 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.955405    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.955669 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:09.955418    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa163a9-849a-4820-990a-b8d1e42d1faa-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:10.445120 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.445083    5967 generic.go:356] "Generic (PLEG): container finished" podID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerID="f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096" exitCode=0
Oct 30 22:29:10.445303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.445137    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"
Oct 30 22:29:10.445303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.445168    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" event={"ID":"ffa163a9-849a-4820-990a-b8d1e42d1faa","Type":"ContainerDied","Data":"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"}
Oct 30 22:29:10.445303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.445223    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p" event={"ID":"ffa163a9-849a-4820-990a-b8d1e42d1faa","Type":"ContainerDied","Data":"caaa4c4cdfc36b75e97e3df9f46869b13db4eec4afba1d3dc8c72349653957d8"}
Oct 30 22:29:10.445303 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.445244    5967 scope.go:122] "RemoveContainer" containerID="f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"
Oct 30 22:29:10.456812 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.456755    5967 scope.go:122] "RemoveContainer" containerID="f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"
Oct 30 22:29:10.457211 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:29:10.457191    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096\": container with ID starting with f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096 not found: ID does not exist" containerID="f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"
Oct 30 22:29:10.457308 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.457220    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096"} err="failed to get container status \"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096\": rpc error: code = NotFound desc = could not find container \"f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096\": container with ID starting with f5b77b1836d6f9a5a29d611ce4e4de3fb2c160423750c942ad7dbfa97a2b3096 not found: ID does not exist"
Oct 30 22:29:10.659538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.659502    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:29:10.709072 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:10.709003    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-27m8p"]
Oct 30 22:29:12.017052 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:29:12.017018    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" path="/var/lib/kubelet/pods/ffa163a9-849a-4820-990a-b8d1e42d1faa/volumes"
Oct 30 22:29:35.592203 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:29:35.592157    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:30:00.183954 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.183915    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184337    5967 cpu_manager.go:414] "containerMap: removing container" podUID="589af8b9-3fa3-4b07-8ffe-611efc680aa3" containerName="revoke-keys"
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184348    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="589af8b9-3fa3-4b07-8ffe-611efc680aa3" containerName="revoke-keys"
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184416    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" containerName="maas-api"
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184421    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" containerName="maas-api"
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184432    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy"
Oct 30 22:30:00.184445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184437    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy"
Oct 30 22:30:00.184645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184501    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3087ca6e-ebe6-4225-a6eb-2259bf0dd1c1" containerName="maas-api"
Oct 30 22:30:00.184645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184509    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffa163a9-849a-4820-990a-b8d1e42d1faa" containerName="istio-proxy"
Oct 30 22:30:00.184645 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.184516    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="589af8b9-3fa3-4b07-8ffe-611efc680aa3" containerName="revoke-keys"
Oct 30 22:30:00.187721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.187705    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:00.187843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.187826    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.191322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.191303    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.209789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.209763    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:00.213316 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.213297    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.233349 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.233319    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:00.236780 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.236765    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.241032 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.241013    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:30:00.284058 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284024    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshqp\" (UniqueName: \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.284261 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284072    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6h98\" (UniqueName: \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.284261 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284168    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvmhn\" (UniqueName: \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.284393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284267    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26j2\" (UniqueName: \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.284393 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284329    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.284520 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284459    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.284580 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284541    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.284877 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.284856    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.293917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.293861    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:00.294449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.294420    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:00.336309 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.335931    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:00.338169 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.338141    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:00.340111 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.340086    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:30:00.340254 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.340111    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:30:00.386077 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386030    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.386077 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386080    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386119    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386154    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386214    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshqp\" (UniqueName: \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386247    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6h98\" (UniqueName: \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386280    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvmhn\" (UniqueName: \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.386403 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386322    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26j2\" (UniqueName: \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.386912 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386888    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.386999 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.386910    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.387060 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.387032    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.387206 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.387188    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.448213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.448144    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6h98\" (UniqueName: \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\") pod \"maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.448558 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.448537    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshqp\" (UniqueName: \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\") pod \"maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.448617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.448568    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvmhn\" (UniqueName: \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\") pod \"maas-api-key-cleanup-29889990-jn7b7\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.448617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.448534    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26j2\" (UniqueName: \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\") pod \"maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.504006 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.503972    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:00.509226 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.509201    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:00.527197 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.527167    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:00.549830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.549196    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:00.884123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.884095    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:00.886476 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:30:00.886449    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab50811a_6ad3_4f4b_968a_d09a1d9c9348.slice/crio-8f2b79ba890804d1846a533076e2cbb93d3487ee9aad1ee4457391a7a6888534 WatchSource:0}: Error finding container 8f2b79ba890804d1846a533076e2cbb93d3487ee9aad1ee4457391a7a6888534: Status 404 returned error can't find the container with id 8f2b79ba890804d1846a533076e2cbb93d3487ee9aad1ee4457391a7a6888534
Oct 30 22:30:00.933597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.933550    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:00.937198 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.937175    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:00.937786 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:30:00.937757    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde7157f_49f1_499b_a686_528ce202b01c.slice/crio-238d762599fb5d335ab566b2764f73824e36a57c38294670b05daad6768ad3b4 WatchSource:0}: Error finding container 238d762599fb5d335ab566b2764f73824e36a57c38294670b05daad6768ad3b4: Status 404 returned error can't find the container with id 238d762599fb5d335ab566b2764f73824e36a57c38294670b05daad6768ad3b4
Oct 30 22:30:00.939562 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:30:00.939527    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee005559_bde7_4be7_a327_f50ab4362479.slice/crio-7c22931fa2e9e94403eef38fa4312bf106225689e521cd23bb65756edbf7f234 WatchSource:0}: Error finding container 7c22931fa2e9e94403eef38fa4312bf106225689e521cd23bb65756edbf7f234: Status 404 returned error can't find the container with id 7c22931fa2e9e94403eef38fa4312bf106225689e521cd23bb65756edbf7f234
Oct 30 22:30:00.988290 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:00.988267    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:01.086603 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:30:01.085778    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095bd569_6c74_4a95_a5b3_00b4d5bda975.slice/crio-6b8ab962b4b64e26b459221a51122f67ed0327230598ed36ed929d195df12cc0 WatchSource:0}: Error finding container 6b8ab962b4b64e26b459221a51122f67ed0327230598ed36ed929d195df12cc0: Status 404 returned error can't find the container with id 6b8ab962b4b64e26b459221a51122f67ed0327230598ed36ed929d195df12cc0
Oct 30 22:30:01.705972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.705934    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerStarted","Data":"5183fa8298846730aaf331637589095cbdf293493c33716ddd530fa256325454"}
Oct 30 22:30:01.706416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.706011    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerStarted","Data":"238d762599fb5d335ab566b2764f73824e36a57c38294670b05daad6768ad3b4"}
Oct 30 22:30:01.707693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.707668    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerStarted","Data":"274ac69497cd9c5701ecd4f7d55a52f765855ae8c1231fcc01247e4eebc09eab"}
Oct 30 22:30:01.707815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.707714    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerStarted","Data":"6b8ab962b4b64e26b459221a51122f67ed0327230598ed36ed929d195df12cc0"}
Oct 30 22:30:01.709355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.709317    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerStarted","Data":"82a2db5278e891abaf292cabbc600062b58a9987f632854ad72064634aba71fe"}
Oct 30 22:30:01.709643 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.709443    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerStarted","Data":"7c22931fa2e9e94403eef38fa4312bf106225689e521cd23bb65756edbf7f234"}
Oct 30 22:30:01.710727 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.710707    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerStarted","Data":"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"}
Oct 30 22:30:01.710802 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.710749    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerStarted","Data":"8f2b79ba890804d1846a533076e2cbb93d3487ee9aad1ee4457391a7a6888534"}
Oct 30 22:30:01.710924 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.710911    5967 scope.go:122] "RemoveContainer" containerID="e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"
Oct 30 22:30:01.823255 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:01.823203    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" podStartSLOduration=1.823189749 podStartE2EDuration="1.823189749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:01.820450048 +0000 UTC m=+2689.935158400" watchObservedRunningTime="2026-10-30 22:30:01.823189749 +0000 UTC m=+2689.937898099"
Oct 30 22:30:02.056009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.055907    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" podStartSLOduration=2.055887634 podStartE2EDuration="2.055887634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:02.05385842 +0000 UTC m=+2690.168566772" watchObservedRunningTime="2026-10-30 22:30:02.055887634 +0000 UTC m=+2690.170595986"
Oct 30 22:30:02.171542 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.171484    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" podStartSLOduration=2.171469926 podStartE2EDuration="2.171469926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:02.170480817 +0000 UTC m=+2690.285189164" watchObservedRunningTime="2026-10-30 22:30:02.171469926 +0000 UTC m=+2690.286178276"
Oct 30 22:30:02.717950 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.717921    5967 generic.go:356] "Generic (PLEG): container finished" podID="fde7157f-49f1-499b-a686-528ce202b01c" containerID="5183fa8298846730aaf331637589095cbdf293493c33716ddd530fa256325454" exitCode=60
Oct 30 22:30:02.718389 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.718010    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerDied","Data":"5183fa8298846730aaf331637589095cbdf293493c33716ddd530fa256325454"}
Oct 30 22:30:02.718389 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.718224    5967 scope.go:122] "RemoveContainer" containerID="5183fa8298846730aaf331637589095cbdf293493c33716ddd530fa256325454"
Oct 30 22:30:02.719683 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.719643    5967 generic.go:356] "Generic (PLEG): container finished" podID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerID="274ac69497cd9c5701ecd4f7d55a52f765855ae8c1231fcc01247e4eebc09eab" exitCode=60
Oct 30 22:30:02.719743 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.719731    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerDied","Data":"274ac69497cd9c5701ecd4f7d55a52f765855ae8c1231fcc01247e4eebc09eab"}
Oct 30 22:30:02.719923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.719905    5967 scope.go:122] "RemoveContainer" containerID="274ac69497cd9c5701ecd4f7d55a52f765855ae8c1231fcc01247e4eebc09eab"
Oct 30 22:30:02.721497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.721474    5967 generic.go:356] "Generic (PLEG): container finished" podID="ee005559-bde7-4be7-a327-f50ab4362479" containerID="82a2db5278e891abaf292cabbc600062b58a9987f632854ad72064634aba71fe" exitCode=60
Oct 30 22:30:02.721608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.721506    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerDied","Data":"82a2db5278e891abaf292cabbc600062b58a9987f632854ad72064634aba71fe"}
Oct 30 22:30:02.721793 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.721771    5967 scope.go:122] "RemoveContainer" containerID="82a2db5278e891abaf292cabbc600062b58a9987f632854ad72064634aba71fe"
Oct 30 22:30:02.723741 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723720    5967 generic.go:356] "Generic (PLEG): container finished" podID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerID="e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d" exitCode=60
Oct 30 22:30:02.723818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723744    5967 generic.go:356] "Generic (PLEG): container finished" podID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerID="0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1" exitCode=60
Oct 30 22:30:02.723818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723783    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerDied","Data":"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"}
Oct 30 22:30:02.723927 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723817    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerDied","Data":"0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1"}
Oct 30 22:30:02.723927 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723834    5967 scope.go:122] "RemoveContainer" containerID="e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"
Oct 30 22:30:02.724026 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.723981    5967 scope.go:122] "RemoveContainer" containerID="0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1"
Oct 30 22:30:02.724165 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:02.724148    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb_odh-ai-gateway-infra(ab50811a-6ad3-4f4b-968a-d09a1d9c9348)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348"
Oct 30 22:30:02.759629 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.759610    5967 scope.go:122] "RemoveContainer" containerID="e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"
Oct 30 22:30:02.759993 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:02.759968    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d\": container with ID starting with e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d not found: ID does not exist" containerID="e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"
Oct 30 22:30:02.760061 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:02.760003    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d"} err="failed to get container status \"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d\": rpc error: code = NotFound desc = could not find container \"e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d\": container with ID starting with e122555bc33137e1fc468138560b07f430b8c812e7f574a77db1a53d5e4f432d not found: ID does not exist"
Oct 30 22:30:03.731656 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.731621    5967 generic.go:356] "Generic (PLEG): container finished" podID="fde7157f-49f1-499b-a686-528ce202b01c" containerID="cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173" exitCode=60
Oct 30 22:30:03.732100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.731715    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerDied","Data":"cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173"}
Oct 30 22:30:03.732100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.731770    5967 scope.go:122] "RemoveContainer" containerID="5183fa8298846730aaf331637589095cbdf293493c33716ddd530fa256325454"
Oct 30 22:30:03.732100 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.732084    5967 scope.go:122] "RemoveContainer" containerID="cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173"
Oct 30 22:30:03.732429 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:03.732406    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh_odh-ai-gateway-infra(fde7157f-49f1-499b-a686-528ce202b01c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" podUID="fde7157f-49f1-499b-a686-528ce202b01c"
Oct 30 22:30:03.733692 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.733670    5967 generic.go:356] "Generic (PLEG): container finished" podID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerID="69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607" exitCode=60
Oct 30 22:30:03.733807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.733758    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerDied","Data":"69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607"}
Oct 30 22:30:03.734004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.733991    5967 scope.go:122] "RemoveContainer" containerID="69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607"
Oct 30 22:30:03.734227 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:03.734209    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt_odh-ai-gateway-infra(095bd569-6c74-4a95-a5b3-00b4d5bda975)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975"
Oct 30 22:30:03.735566 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.735550    5967 generic.go:356] "Generic (PLEG): container finished" podID="ee005559-bde7-4be7-a327-f50ab4362479" containerID="c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031" exitCode=60
Oct 30 22:30:03.735642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.735616    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerDied","Data":"c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031"}
Oct 30 22:30:03.735883 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.735865    5967 scope.go:122] "RemoveContainer" containerID="c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031"
Oct 30 22:30:03.736112 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:03.736094    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-jn7b7_odh-ai-gateway-infra(ee005559-bde7-4be7-a327-f50ab4362479)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" podUID="ee005559-bde7-4be7-a327-f50ab4362479"
Oct 30 22:30:03.737342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.737319    5967 scope.go:122] "RemoveContainer" containerID="0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1"
Oct 30 22:30:03.737559 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:03.737543    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb_odh-ai-gateway-infra(ab50811a-6ad3-4f4b-968a-d09a1d9c9348)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348"
Oct 30 22:30:03.782203 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.782182    5967 scope.go:122] "RemoveContainer" containerID="274ac69497cd9c5701ecd4f7d55a52f765855ae8c1231fcc01247e4eebc09eab"
Oct 30 22:30:03.794478 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:03.794457    5967 scope.go:122] "RemoveContainer" containerID="82a2db5278e891abaf292cabbc600062b58a9987f632854ad72064634aba71fe"
Oct 30 22:30:04.744407 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:04.744361    5967 scope.go:122] "RemoveContainer" containerID="cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173"
Oct 30 22:30:04.744917 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:04.744634    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh_odh-ai-gateway-infra(fde7157f-49f1-499b-a686-528ce202b01c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" podUID="fde7157f-49f1-499b-a686-528ce202b01c"
Oct 30 22:30:04.745945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:04.745922    5967 scope.go:122] "RemoveContainer" containerID="69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607"
Oct 30 22:30:04.746173 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:04.746141    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt_odh-ai-gateway-infra(095bd569-6c74-4a95-a5b3-00b4d5bda975)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975"
Oct 30 22:30:04.747470 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:04.747454    5967 scope.go:122] "RemoveContainer" containerID="c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031"
Oct 30 22:30:04.747655 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:04.747638    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-jn7b7_odh-ai-gateway-infra(ee005559-bde7-4be7-a327-f50ab4362479)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" podUID="ee005559-bde7-4be7-a327-f50ab4362479"
Oct 30 22:30:05.594438 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:05.594401    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:30:14.011885 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:14.011842    5967 scope.go:122] "RemoveContainer" containerID="0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1"
Oct 30 22:30:14.807525 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:14.807490    5967 generic.go:356] "Generic (PLEG): container finished" podID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerID="e096b4cf5959d3684ad1000d8053ec2dff190785125f1f6754de2ffba0252c28" exitCode=60
Oct 30 22:30:14.807712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:14.807558    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerDied","Data":"e096b4cf5959d3684ad1000d8053ec2dff190785125f1f6754de2ffba0252c28"}
Oct 30 22:30:14.807712 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:14.807653    5967 scope.go:122] "RemoveContainer" containerID="0e175e191b507a742d03eb437443c6faed42b9dcae04f6da86dc45f8e7d43de1"
Oct 30 22:30:14.808012 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:14.807990    5967 scope.go:122] "RemoveContainer" containerID="e096b4cf5959d3684ad1000d8053ec2dff190785125f1f6754de2ffba0252c28"
Oct 30 22:30:14.808305 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:14.808284    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb_odh-ai-gateway-infra(ab50811a-6ad3-4f4b-968a-d09a1d9c9348)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348"
Oct 30 22:30:15.328171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:15.328133    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:30:15.346642 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:15.346616    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:30:15.934485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:15.934456    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:16.011713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.011684    5967 scope.go:122] "RemoveContainer" containerID="c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031"
Oct 30 22:30:16.011951 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.011803    5967 scope.go:122] "RemoveContainer" containerID="69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607"
Oct 30 22:30:16.011951 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.011941    5967 scope.go:122] "RemoveContainer" containerID="cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173"
Oct 30 22:30:16.106418 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.106396    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:16.258685 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.258655    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\") pod \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") "
Oct 30 22:30:16.258866 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.258728    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\" (UniqueName: \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\") pod \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\" (UID: \"ab50811a-6ad3-4f4b-968a-d09a1d9c9348\") "
Oct 30 22:30:16.259014 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.258990    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca" pod "ab50811a-6ad3-4f4b-968a-d09a1d9c9348" (UID: "ab50811a-6ad3-4f4b-968a-d09a1d9c9348"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:16.259171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.259157    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:16.283306 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.283271    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp" pod "ab50811a-6ad3-4f4b-968a-d09a1d9c9348" (UID: "ab50811a-6ad3-4f4b-968a-d09a1d9c9348"). InnerVolumeSpecName "kube-api-access-lshqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:16.360287 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.360257    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lshqp\" (UniqueName: \"kubernetes.io/projected/ab50811a-6ad3-4f4b-968a-d09a1d9c9348-kube-api-access-lshqp\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:16.822004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.821965    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerStarted","Data":"58377c85248c41686026704d7628047053e2997b20939729dd67dcbb5f441250"}
Oct 30 22:30:16.823796 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.823767    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerStarted","Data":"145c4ff39b86cd79903e3538b6ae259ac08fa55180470d14358022aabb7ff39c"}
Oct 30 22:30:16.825079 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.825062    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"
Oct 30 22:30:16.825199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.825085    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb" event={"ID":"ab50811a-6ad3-4f4b-968a-d09a1d9c9348","Type":"ContainerDied","Data":"8f2b79ba890804d1846a533076e2cbb93d3487ee9aad1ee4457391a7a6888534"}
Oct 30 22:30:16.825199 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.825133    5967 scope.go:122] "RemoveContainer" containerID="e096b4cf5959d3684ad1000d8053ec2dff190785125f1f6754de2ffba0252c28"
Oct 30 22:30:16.826847 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:16.826829    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerStarted","Data":"bb3a42394d39599bb1e46d269437c8afedbf061eb8418ec196f9caccbf3517c8"}
Oct 30 22:30:17.052123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.052096    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:17.057730 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.057703    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-b9fbe2-29889990-84vrb"]
Oct 30 22:30:17.834018 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.833986    5967 generic.go:356] "Generic (PLEG): container finished" podID="ee005559-bde7-4be7-a327-f50ab4362479" containerID="145c4ff39b86cd79903e3538b6ae259ac08fa55180470d14358022aabb7ff39c" exitCode=60
Oct 30 22:30:17.834527 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.834062    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerDied","Data":"145c4ff39b86cd79903e3538b6ae259ac08fa55180470d14358022aabb7ff39c"}
Oct 30 22:30:17.834527 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.834120    5967 scope.go:122] "RemoveContainer" containerID="c85ce6422b957218e339f80dd087bbd2763bab4f8fc597c20a7ea4804ca2b031"
Oct 30 22:30:17.834527 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.834515    5967 scope.go:122] "RemoveContainer" containerID="145c4ff39b86cd79903e3538b6ae259ac08fa55180470d14358022aabb7ff39c"
Oct 30 22:30:17.834827 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:17.834798    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-jn7b7_odh-ai-gateway-infra(ee005559-bde7-4be7-a327-f50ab4362479)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" podUID="ee005559-bde7-4be7-a327-f50ab4362479"
Oct 30 22:30:17.836919 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.836900    5967 generic.go:356] "Generic (PLEG): container finished" podID="fde7157f-49f1-499b-a686-528ce202b01c" containerID="bb3a42394d39599bb1e46d269437c8afedbf061eb8418ec196f9caccbf3517c8" exitCode=60
Oct 30 22:30:17.837025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.836974    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerDied","Data":"bb3a42394d39599bb1e46d269437c8afedbf061eb8418ec196f9caccbf3517c8"}
Oct 30 22:30:17.837338 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.837303    5967 scope.go:122] "RemoveContainer" containerID="bb3a42394d39599bb1e46d269437c8afedbf061eb8418ec196f9caccbf3517c8"
Oct 30 22:30:17.837597 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:17.837577    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh_odh-ai-gateway-infra(fde7157f-49f1-499b-a686-528ce202b01c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" podUID="fde7157f-49f1-499b-a686-528ce202b01c"
Oct 30 22:30:17.838747 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.838728    5967 generic.go:356] "Generic (PLEG): container finished" podID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerID="58377c85248c41686026704d7628047053e2997b20939729dd67dcbb5f441250" exitCode=60
Oct 30 22:30:17.838826 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.838762    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerDied","Data":"58377c85248c41686026704d7628047053e2997b20939729dd67dcbb5f441250"}
Oct 30 22:30:17.839059 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.839047    5967 scope.go:122] "RemoveContainer" containerID="58377c85248c41686026704d7628047053e2997b20939729dd67dcbb5f441250"
Oct 30 22:30:17.839272 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:17.839252    5967 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt_odh-ai-gateway-infra(095bd569-6c74-4a95-a5b3-00b4d5bda975)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975"
Oct 30 22:30:17.846025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.846008    5967 scope.go:122] "RemoveContainer" containerID="cff8d20bbbe8b3c019ce81b3d08739e8f3196c7706ebb25462174a8a09f13173"
Oct 30 22:30:17.858002 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.857988    5967 scope.go:122] "RemoveContainer" containerID="69ec053aacfcfa9aa841ae3b361b6e50ea4ab3f0ba139b4b63fd2aba85c72607"
Oct 30 22:30:17.947109 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:17.947077    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:18.017259 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:18.017227    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" path="/var/lib/kubelet/pods/ab50811a-6ad3-4f4b-968a-d09a1d9c9348/volumes"
Oct 30 22:30:18.184778 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:18.184687    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:18.298085 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:18.298053    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:19.012486 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.012460    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:19.045578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.045552    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:19.057147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.057121    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:19.192327 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192221    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\" (UniqueName: \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\") pod \"fde7157f-49f1-499b-a686-528ce202b01c\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") "
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192438    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\") pod \"ee005559-bde7-4be7-a327-f50ab4362479\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") "
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192509    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\") pod \"fde7157f-49f1-499b-a686-528ce202b01c\" (UID: \"fde7157f-49f1-499b-a686-528ce202b01c\") "
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192618    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\" (UniqueName: \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\") pod \"095bd569-6c74-4a95-a5b3-00b4d5bda975\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") "
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192903    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca" pod "ee005559-bde7-4be7-a327-f50ab4362479" (UID: "ee005559-bde7-4be7-a327-f50ab4362479"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192909    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\") pod \"095bd569-6c74-4a95-a5b3-00b4d5bda975\" (UID: \"095bd569-6c74-4a95-a5b3-00b4d5bda975\") "
Oct 30 22:30:19.193102 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.192983    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\" (UniqueName: \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\") pod \"ee005559-bde7-4be7-a327-f50ab4362479\" (UID: \"ee005559-bde7-4be7-a327-f50ab4362479\") "
Oct 30 22:30:19.193586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.193219    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca" pod "095bd569-6c74-4a95-a5b3-00b4d5bda975" (UID: "095bd569-6c74-4a95-a5b3-00b4d5bda975"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:19.193586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.193414    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca" pod "fde7157f-49f1-499b-a686-528ce202b01c" (UID: "fde7157f-49f1-499b-a686-528ce202b01c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:19.193586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.193532    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095bd569-6c74-4a95-a5b3-00b4d5bda975-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.193586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.193553    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee005559-bde7-4be7-a327-f50ab4362479-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.193586 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.193567    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde7157f-49f1-499b-a686-528ce202b01c-maas-api-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.195277 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.195247    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn" pod "ee005559-bde7-4be7-a327-f50ab4362479" (UID: "ee005559-bde7-4be7-a327-f50ab4362479"). InnerVolumeSpecName "kube-api-access-dvmhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:19.195386 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.195309    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2" pod "095bd569-6c74-4a95-a5b3-00b4d5bda975" (UID: "095bd569-6c74-4a95-a5b3-00b4d5bda975"). InnerVolumeSpecName "kube-api-access-g26j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:19.195649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.195632    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98" pod "fde7157f-49f1-499b-a686-528ce202b01c" (UID: "fde7157f-49f1-499b-a686-528ce202b01c"). InnerVolumeSpecName "kube-api-access-x6h98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:19.294325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.294280    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g26j2\" (UniqueName: \"kubernetes.io/projected/095bd569-6c74-4a95-a5b3-00b4d5bda975-kube-api-access-g26j2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.294325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.294315    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvmhn\" (UniqueName: \"kubernetes.io/projected/ee005559-bde7-4be7-a327-f50ab4362479-kube-api-access-dvmhn\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.294325 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.294326    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6h98\" (UniqueName: \"kubernetes.io/projected/fde7157f-49f1-499b-a686-528ce202b01c-kube-api-access-x6h98\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.854859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.854829    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"
Oct 30 22:30:19.854859 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.854849    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt" event={"ID":"095bd569-6c74-4a95-a5b3-00b4d5bda975","Type":"ContainerDied","Data":"6b8ab962b4b64e26b459221a51122f67ed0327230598ed36ed929d195df12cc0"}
Oct 30 22:30:19.855123 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.854916    5967 scope.go:122] "RemoveContainer" containerID="58377c85248c41686026704d7628047053e2997b20939729dd67dcbb5f441250"
Oct 30 22:30:19.856264 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.856245    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"
Oct 30 22:30:19.856429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.856286    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7" event={"ID":"ee005559-bde7-4be7-a327-f50ab4362479","Type":"ContainerDied","Data":"7c22931fa2e9e94403eef38fa4312bf106225689e521cd23bb65756edbf7f234"}
Oct 30 22:30:19.857775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.857754    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh" event={"ID":"fde7157f-49f1-499b-a686-528ce202b01c","Type":"ContainerDied","Data":"238d762599fb5d335ab566b2764f73824e36a57c38294670b05daad6768ad3b4"}
Oct 30 22:30:19.857882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.857781    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"
Oct 30 22:30:19.866300 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.866278    5967 scope.go:122] "RemoveContainer" containerID="145c4ff39b86cd79903e3538b6ae259ac08fa55180470d14358022aabb7ff39c"
Oct 30 22:30:19.875925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:19.875906    5967 scope.go:122] "RemoveContainer" containerID="bb3a42394d39599bb1e46d269437c8afedbf061eb8418ec196f9caccbf3517c8"
Oct 30 22:30:20.019440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.019408    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:20.024029 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.023997    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-87b6b3-29889990-5mkpt"]
Oct 30 22:30:20.132843 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.132753    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:20.136980 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.136952    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-jn7b7"]
Oct 30 22:30:20.246220 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.246186    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:20.249487 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:20.249463    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-026c11-29889990-z54rh"]
Oct 30 22:30:22.017544 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:22.017469    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" path="/var/lib/kubelet/pods/095bd569-6c74-4a95-a5b3-00b4d5bda975/volumes"
Oct 30 22:30:22.017902 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:22.017855    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee005559-bde7-4be7-a327-f50ab4362479" path="/var/lib/kubelet/pods/ee005559-bde7-4be7-a327-f50ab4362479/volumes"
Oct 30 22:30:22.018184 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:22.018170    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fde7157f-49f1-499b-a686-528ce202b01c" path="/var/lib/kubelet/pods/fde7157f-49f1-499b-a686-528ce202b01c/volumes"
Oct 30 22:30:34.889039 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:34.889003    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:30:34.889647 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:34.889255    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery" containerID="cri-o://390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7" gracePeriod=30
Oct 30 22:30:35.152662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.152611    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:30:35.255496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255470    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255512    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255573    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255598    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255653 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255613    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255696    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.255882 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.255744    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\") pod \"d2f1508f-94e7-493e-ad29-22124b549f23\" (UID: \"d2f1508f-94e7-493e-ad29-22124b549f23\") "
Oct 30 22:30:35.256234 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.256200    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:35.256853 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.256831    5967 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-ca-configmap\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.258113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258081    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:35.258221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258173    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:35.258448 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258428    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:35.258533 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258485    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:35.258587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258528    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:35.258638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.258620    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888" pod "d2f1508f-94e7-493e-ad29-22124b549f23" (UID: "d2f1508f-94e7-493e-ad29-22124b549f23"). InnerVolumeSpecName "kube-api-access-gj888". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:35.357579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357537    5967 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f1508f-94e7-493e-ad29-22124b549f23-local-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.357579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357575    5967 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-cacerts\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.357579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357585    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj888\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-kube-api-access-gj888\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.357579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357596    5967 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-csr-dns-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.357841 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357605    5967 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2f1508f-94e7-493e-ad29-22124b549f23-istio-kubeconfig\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.357841 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.357613    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f1508f-94e7-493e-ad29-22124b549f23-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:35.592058 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:35.592024    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:30:35.946172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.946089    5967 generic.go:356] "Generic (PLEG): container finished" podID="d2f1508f-94e7-493e-ad29-22124b549f23" containerID="390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7" exitCode=0
Oct 30 22:30:35.946172 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.946143    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"
Oct 30 22:30:35.946621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.946183    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" event={"ID":"d2f1508f-94e7-493e-ad29-22124b549f23","Type":"ContainerDied","Data":"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"}
Oct 30 22:30:35.946621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.946247    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm" event={"ID":"d2f1508f-94e7-493e-ad29-22124b549f23","Type":"ContainerDied","Data":"01b017286fe491fc01ae31a247def52a73503f2d5f5ada8c1b900fdccb55cd77"}
Oct 30 22:30:35.946621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.946272    5967 scope.go:122] "RemoveContainer" containerID="390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"
Oct 30 22:30:35.957557 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.957540    5967 scope.go:122] "RemoveContainer" containerID="390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"
Oct 30 22:30:35.957824 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:30:35.957805    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7\": container with ID starting with 390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7 not found: ID does not exist" containerID="390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"
Oct 30 22:30:35.957867 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:35.957833    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7"} err="failed to get container status \"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7\": rpc error: code = NotFound desc = could not find container \"390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7\": container with ID starting with 390cafe9cbf1b837e8c92adad0dca4c0edba102919283e397ad2621987bad7d7 not found: ID does not exist"
Oct 30 22:30:36.162155 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:36.162121    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:30:36.211990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:36.211907    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sxwsm"]
Oct 30 22:30:38.017755 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:30:38.017721    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" path="/var/lib/kubelet/pods/d2f1508f-94e7-493e-ad29-22124b549f23/volumes"
Oct 30 22:31:05.591994 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:31:05.591949    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:31:11.139162 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139129    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:31:11.139808 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139771    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.139808 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139793    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.139808 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139809    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139817    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139827    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139834    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139858    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139865    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139877    5967 cpu_manager.go:414] "containerMap: removing container" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139884    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139895    5967 cpu_manager.go:414] "containerMap: removing container" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139904    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139920    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139929    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139946    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139953    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.139984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139983    5967 cpu_manager.go:414] "containerMap: removing container" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.139991    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140096    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140108    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140118    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140127    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2f1508f-94e7-493e-ad29-22124b549f23" containerName="discovery"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140137    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140146    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140156    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140165    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140176    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:31:11.140674 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.140185    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:31:11.143671 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.143648    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.210011 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.209979    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c04440\"/\"kube-root-ca.crt\""
Oct 30 22:31:11.224461 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224425    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.224617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224486    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.224617 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224604    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.224707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224644    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.224759 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224737    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.224804 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.224782    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2t4j\" (UniqueName: \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.247496 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.247475    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c04440\"/\"openshift-service-ca.crt\""
Oct 30 22:31:11.247630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.247619    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c04440\"/\"test-model-c04440-kserve-self-signed-certs\""
Oct 30 22:31:11.247630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.247623    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c04440\"/\"default-dockercfg-ngq4g\""
Oct 30 22:31:11.249343 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.249326    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:31:11.325912 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.325873    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2t4j\" (UniqueName: \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.325951    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326004    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326034    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326068    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326322 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326142    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326549    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326581    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.326707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.326629    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.328354 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.328337    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.328554 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.328538    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.387180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.387148    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2t4j\" (UniqueName: \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\") pod \"test-model-c04440-kserve-56676cf68f-lhltm\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") " pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.456518 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.456437    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:11.848282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.848161    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:31:11.851165 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:31:11.851135    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddabc7d76_1725_4b90_88ec_f9889ca298c0.slice/crio-bd179b5509eb197bcf594f4db3eaa03d355753500721dc65ac7a9092fbf720b9 WatchSource:0}: Error finding container bd179b5509eb197bcf594f4db3eaa03d355753500721dc65ac7a9092fbf720b9: Status 404 returned error can't find the container with id bd179b5509eb197bcf594f4db3eaa03d355753500721dc65ac7a9092fbf720b9
Oct 30 22:31:11.919515 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.919485    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:31:11.919723 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:11.919698    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" containerID="cri-o://bebd44bb8ceac861cc8d406519f9af63fa619a266c61f71e0ad98b21c1c05036" gracePeriod=30
Oct 30 22:31:12.137904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:12.137816    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" event={"ID":"dabc7d76-1725-4b90-88ec-f9889ca298c0","Type":"ContainerStarted","Data":"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"}
Oct 30 22:31:12.137904 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:12.137866    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" event={"ID":"dabc7d76-1725-4b90-88ec-f9889ca298c0","Type":"ContainerStarted","Data":"bd179b5509eb197bcf594f4db3eaa03d355753500721dc65ac7a9092fbf720b9"}
Oct 30 22:31:12.256880 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:12.256827    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" podStartSLOduration=1.256813857 podStartE2EDuration="1.256813857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:31:12.2548421 +0000 UTC m=+2760.369550452" watchObservedRunningTime="2026-10-30 22:31:12.256813857 +0000 UTC m=+2760.371522208"
Oct 30 22:31:12.457263 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:12.457194    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:13.579982 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:13.579944    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-gfbt5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:31:13.580361 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:13.580004    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:31:17.166640 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.166610    5967 generic.go:356] "Generic (PLEG): container finished" podID="417aa34f-52c5-4319-82aa-17abe7820334" containerID="bebd44bb8ceac861cc8d406519f9af63fa619a266c61f71e0ad98b21c1c05036" exitCode=0
Oct 30 22:31:17.167003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.166689    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" event={"ID":"417aa34f-52c5-4319-82aa-17abe7820334","Type":"ContainerDied","Data":"bebd44bb8ceac861cc8d406519f9af63fa619a266c61f71e0ad98b21c1c05036"}
Oct 30 22:31:17.167003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.166737    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5" event={"ID":"417aa34f-52c5-4319-82aa-17abe7820334","Type":"ContainerDied","Data":"069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f"}
Oct 30 22:31:17.167003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.166755    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="069bd8d149f7219a3c733095c2ab5d9aafeb09687a017d4c41f6d0b2fefb3a9f"
Oct 30 22:31:17.177920 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.177898    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:31:17.286937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.286904    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.286937 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.286938    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.286961    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.286989    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287018    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287129    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287163    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287215    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287258    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\") pod \"417aa34f-52c5-4319-82aa-17abe7820334\" (UID: \"417aa34f-52c5-4319-82aa-17abe7820334\") "
Oct 30 22:31:17.287485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287260    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:17.287485 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287278    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:17.287696 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287567    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:17.287809 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287781    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:17.287956 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.287930    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:17.288047 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.288029    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.288096 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.288056    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.288096 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.288073    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.289662 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.289636    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:17.289865 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.289842    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:17.289929 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.289903    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:31:17.289982 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.289936    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq" pod "417aa34f-52c5-4319-82aa-17abe7820334" (UID: "417aa34f-52c5-4319-82aa-17abe7820334"). InnerVolumeSpecName "kube-api-access-2q6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:17.388895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388864    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417aa34f-52c5-4319-82aa-17abe7820334-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.388895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388888    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.388895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388897    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.389112 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388908    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q6mq\" (UniqueName: \"kubernetes.io/projected/417aa34f-52c5-4319-82aa-17abe7820334-kube-api-access-2q6mq\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.389112 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388917    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417aa34f-52c5-4319-82aa-17abe7820334-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:17.389112 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:17.388925    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417aa34f-52c5-4319-82aa-17abe7820334-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:18.171275 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:18.171244    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"
Oct 30 22:31:18.335608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:18.335526    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:31:18.385473 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:18.385435    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gfbt5"]
Oct 30 22:31:20.017663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:20.017633    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="417aa34f-52c5-4319-82aa-17abe7820334" path="/var/lib/kubelet/pods/417aa34f-52c5-4319-82aa-17abe7820334/volumes"
Oct 30 22:31:21.457009 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:21.456973    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:21.469166 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:21.469143    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:22.202613 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:22.202586    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:31:35.593558 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:31:35.593517    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:31:57.197129 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:57.197093    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:31:57.197634 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:31:57.197304    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy" containerID="cri-o://e71bfef8e34dc2c9d60f5825c14d74ed81dd550a5cada96af9e5d6aeb18b428b" gracePeriod=30
Oct 30 22:32:02.388690 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.388657    5967 generic.go:356] "Generic (PLEG): container finished" podID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerID="e71bfef8e34dc2c9d60f5825c14d74ed81dd550a5cada96af9e5d6aeb18b428b" exitCode=0
Oct 30 22:32:02.389176 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.388715    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" event={"ID":"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad","Type":"ContainerDied","Data":"e71bfef8e34dc2c9d60f5825c14d74ed81dd550a5cada96af9e5d6aeb18b428b"}
Oct 30 22:32:02.450218 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.450193    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:32:02.551378 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551349    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551412    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551584 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551552    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551619 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551594    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551693 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551658    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551751 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551711    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551815 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551798    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551872 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551839    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.551930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551879    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\") pod \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\" (UID: \"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad\") "
Oct 30 22:32:02.552005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551920    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:02.552005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.551914    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:02.552122 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552098    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:02.552191 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552125    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:02.553071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552438    5967 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.553071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552450    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:02.553071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552464    5967 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istiod-ca-cert\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.553071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552478    5967 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-workload-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.553071 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.552491    5967 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-data\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.553900 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.553877    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:02.554492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.554463    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:02.554589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.554493    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "kube-api-access-2qbp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:02.554589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.554542    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo" pod "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" (UID: "5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:32:02.653831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.653803    5967 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-podinfo\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.653831 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.653829    5967 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-credential-socket\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.654021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.653840    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qbp2\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-kube-api-access-2qbp2\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.654021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.653850    5967 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-token\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:02.654021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:02.653862    5967 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad-istio-envoy\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:03.395934 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:03.395902    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"
Oct 30 22:32:03.396394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:03.395936    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc" event={"ID":"5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad","Type":"ContainerDied","Data":"25fb7cec27b5cfa69b80ece4deb45920b64a0fe11c83f18be9c5ca946cf6e452"}
Oct 30 22:32:03.396394 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:03.396003    5967 scope.go:122] "RemoveContainer" containerID="e71bfef8e34dc2c9d60f5825c14d74ed81dd550a5cada96af9e5d6aeb18b428b"
Oct 30 22:32:03.611925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:03.611887    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:32:03.617707 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:03.617682    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-bk4mc"]
Oct 30 22:32:04.021574 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:04.020055    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" path="/var/lib/kubelet/pods/5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad/volumes"
Oct 30 22:32:05.591700 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:32:05.591662    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:32:13.423680 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:32:13.423646    5967 scope.go:122] "RemoveContainer" containerID="bebd44bb8ceac861cc8d406519f9af63fa619a266c61f71e0ad98b21c1c05036"
Oct 30 22:32:35.591842 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:32:35.591796    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:33:03.332672 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.332636    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"]
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333028    5967 cpu_manager.go:414] "containerMap: removing container" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333039    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333050    5967 cpu_manager.go:414] "containerMap: removing container" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333055    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333067    5967 cpu_manager.go:414] "containerMap: removing container" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333073    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333083    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333087    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333094    5967 cpu_manager.go:414] "containerMap: removing container" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333099    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333153    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:33:03.333164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333161    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee005559-bde7-4be7-a327-f50ab4362479" containerName="cleanup"
Oct 30 22:33:03.333567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333234    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="417aa34f-52c5-4319-82aa-17abe7820334" containerName="istio-proxy"
Oct 30 22:33:03.333567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333243    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab50811a-6ad3-4f4b-968a-d09a1d9c9348" containerName="cleanup"
Oct 30 22:33:03.333567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333249    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c3c1601-fe9b-44cd-9ba7-559e3a1f8fad" containerName="istio-proxy"
Oct 30 22:33:03.333567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333258    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="095bd569-6c74-4a95-a5b3-00b4d5bda975" containerName="cleanup"
Oct 30 22:33:03.333567 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.333266    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde7157f-49f1-499b-a686-528ce202b01c" containerName="cleanup"
Oct 30 22:33:03.336486 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.336465    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.389124 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.389093    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:33:03.407164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.407135    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:33:03.440036 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.440005    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"]
Oct 30 22:33:03.442014 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.441987    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.442140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.442090    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qmz\" (UniqueName: \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.442140 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.442120    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.458185 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.458164    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:33:03.458334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.458274    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:33:03.543715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.543680    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.543923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.543737    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qmz\" (UniqueName: \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.543923 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.543758    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.544492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.544467    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.546227 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.546211    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.605280 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.605204    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qmz\" (UniqueName: \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\") pod \"maas-api-revoke-sub-e2f0c9e2-8qrbt\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:03.650390 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:03.650341    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:04.024770 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:04.024685    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"]
Oct 30 22:33:04.027568 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:33:04.027537    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297d6175_0570_41bd_8627_de53d307f3ea.slice/crio-a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d WatchSource:0}: Error finding container a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d: Status 404 returned error can't find the container with id a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d
Oct 30 22:33:04.695411 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:04.695305    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt" event={"ID":"297d6175-0570-41bd-8627-de53d307f3ea","Type":"ContainerStarted","Data":"b7d23b2c8de10d186aa59e884d93de475f2ec410da08d9e10acdef4d19b6a962"}
Oct 30 22:33:04.695411 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:04.695360    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt" event={"ID":"297d6175-0570-41bd-8627-de53d307f3ea","Type":"ContainerStarted","Data":"a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d"}
Oct 30 22:33:04.812290 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:04.812240    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt" podStartSLOduration=1.812225272 podStartE2EDuration="1.812225272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:04.810800171 +0000 UTC m=+2872.925508519" watchObservedRunningTime="2026-10-30 22:33:04.812225272 +0000 UTC m=+2872.926933622"
Oct 30 22:33:05.592843 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:33:05.592806    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:33:05.702136 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:05.702103    5967 generic.go:356] "Generic (PLEG): container finished" podID="297d6175-0570-41bd-8627-de53d307f3ea" containerID="b7d23b2c8de10d186aa59e884d93de475f2ec410da08d9e10acdef4d19b6a962" exitCode=0
Oct 30 22:33:05.702618 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:05.702147    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt" event={"ID":"297d6175-0570-41bd-8627-de53d307f3ea","Type":"ContainerDied","Data":"b7d23b2c8de10d186aa59e884d93de475f2ec410da08d9e10acdef4d19b6a962"}
Oct 30 22:33:06.842670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.842646    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:06.876055 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.876022    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\") pod \"297d6175-0570-41bd-8627-de53d307f3ea\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") "
Oct 30 22:33:06.876245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.876081    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\" (UniqueName: \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\") pod \"297d6175-0570-41bd-8627-de53d307f3ea\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") "
Oct 30 22:33:06.876245 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.876104    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\") pod \"297d6175-0570-41bd-8627-de53d307f3ea\" (UID: \"297d6175-0570-41bd-8627-de53d307f3ea\") "
Oct 30 22:33:06.876468 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.876443    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca" pod "297d6175-0570-41bd-8627-de53d307f3ea" (UID: "297d6175-0570-41bd-8627-de53d307f3ea"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:06.878429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.878406    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca" pod "297d6175-0570-41bd-8627-de53d307f3ea" (UID: "297d6175-0570-41bd-8627-de53d307f3ea"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:06.878429 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.878415    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz" pod "297d6175-0570-41bd-8627-de53d307f3ea" (UID: "297d6175-0570-41bd-8627-de53d307f3ea"). InnerVolumeSpecName "kube-api-access-p7qmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:06.977253 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.977220    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:06.977440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.977258    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7qmz\" (UniqueName: \"kubernetes.io/projected/297d6175-0570-41bd-8627-de53d307f3ea-kube-api-access-p7qmz\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:06.977440 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:06.977275    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/297d6175-0570-41bd-8627-de53d307f3ea-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.712038 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:07.712000    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt" event={"ID":"297d6175-0570-41bd-8627-de53d307f3ea","Type":"ContainerDied","Data":"a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d"}
Oct 30 22:33:07.712219 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:07.712058    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a06b01a8cbc7141277d676fef9f49927a0a9ce355edcef2fa5174ade1230179d"
Oct 30 22:33:07.712219 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:07.712078    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"
Oct 30 22:33:11.060624 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:11.060588    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"]
Oct 30 22:33:11.110411 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:11.110354    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a12bd7fc-8t8bf"]
Oct 30 22:33:12.017034 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:12.016999    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53fcaebe-ccaa-4879-a83a-a4196f6adb61" path="/var/lib/kubelet/pods/53fcaebe-ccaa-4879-a83a-a4196f6adb61/volumes"
Oct 30 22:33:17.055365 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.055327    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"]
Oct 30 22:33:17.104592 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.104557    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-01fa7403-gqk4m"]
Oct 30 22:33:17.126033 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.125995    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"]
Oct 30 22:33:17.126507 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.126489    5967 cpu_manager.go:414] "containerMap: removing container" podUID="297d6175-0570-41bd-8627-de53d307f3ea" containerName="revoke-keys"
Oct 30 22:33:17.126608 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.126508    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="297d6175-0570-41bd-8627-de53d307f3ea" containerName="revoke-keys"
Oct 30 22:33:17.126665 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.126634    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="297d6175-0570-41bd-8627-de53d307f3ea" containerName="revoke-keys"
Oct 30 22:33:17.129832 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.129812    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.184561 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.184510    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:33:17.184773 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.184594    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:33:17.184773 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.184610    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:33:17.184773 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.184729    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:33:17.187202 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.187176    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.187319 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.187216    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.187404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.187362    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzz7\" (UniqueName: \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.216587 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.216558    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"]
Oct 30 22:33:17.288709 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.288675    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzz7\" (UniqueName: \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.288866 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.288729    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.288866 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.288752    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.289538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.289462    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.291220 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.291200    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.350234 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.350159    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzz7\" (UniqueName: \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\") pod \"maas-api-revoke-sub-d61257e3-r5v7t\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.442647 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.442614    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:17.815135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:17.815106    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"]
Oct 30 22:33:17.817832 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:33:17.817802    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a50574f_7c14_47fc_bfd7_c519c192b310.slice/crio-f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3 WatchSource:0}: Error finding container f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3: Status 404 returned error can't find the container with id f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3
Oct 30 22:33:18.017212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:18.017179    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="589af8b9-3fa3-4b07-8ffe-611efc680aa3" path="/var/lib/kubelet/pods/589af8b9-3fa3-4b07-8ffe-611efc680aa3/volumes"
Oct 30 22:33:18.771260 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:18.771222    5967 generic.go:356] "Generic (PLEG): container finished" podID="9a50574f-7c14-47fc-bfd7-c519c192b310" containerID="95a8633ce888c12ca2bba2e7cbfc14eaab1410a580ca84c1e68de15b22adf75c" exitCode=0
Oct 30 22:33:18.771639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:18.771272    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t" event={"ID":"9a50574f-7c14-47fc-bfd7-c519c192b310","Type":"ContainerDied","Data":"95a8633ce888c12ca2bba2e7cbfc14eaab1410a580ca84c1e68de15b22adf75c"}
Oct 30 22:33:18.771639 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:18.771320    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t" event={"ID":"9a50574f-7c14-47fc-bfd7-c519c192b310","Type":"ContainerStarted","Data":"f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3"}
Oct 30 22:33:19.927428 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:19.927405    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:20.017766 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.017730    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\" (UniqueName: \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\") pod \"9a50574f-7c14-47fc-bfd7-c519c192b310\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") "
Oct 30 22:33:20.017910 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.017816    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\") pod \"9a50574f-7c14-47fc-bfd7-c519c192b310\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") "
Oct 30 22:33:20.017910 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.017877    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\") pod \"9a50574f-7c14-47fc-bfd7-c519c192b310\" (UID: \"9a50574f-7c14-47fc-bfd7-c519c192b310\") "
Oct 30 22:33:20.018221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.018194    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca" pod "9a50574f-7c14-47fc-bfd7-c519c192b310" (UID: "9a50574f-7c14-47fc-bfd7-c519c192b310"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:20.019907 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.019883    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7" pod "9a50574f-7c14-47fc-bfd7-c519c192b310" (UID: "9a50574f-7c14-47fc-bfd7-c519c192b310"). InnerVolumeSpecName "kube-api-access-zwzz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:20.020030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.019921    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca" pod "9a50574f-7c14-47fc-bfd7-c519c192b310" (UID: "9a50574f-7c14-47fc-bfd7-c519c192b310"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:20.119698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.119620    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwzz7\" (UniqueName: \"kubernetes.io/projected/9a50574f-7c14-47fc-bfd7-c519c192b310-kube-api-access-zwzz7\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:20.119698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.119647    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:20.119698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.119657    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9a50574f-7c14-47fc-bfd7-c519c192b310-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:20.784497 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.784461    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t" event={"ID":"9a50574f-7c14-47fc-bfd7-c519c192b310","Type":"ContainerDied","Data":"f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3"}
Oct 30 22:33:20.784670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.784517    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3949d2c8cdaf492787fb0ab2953b3e17049896043275dc214dd9b057632d9e3"
Oct 30 22:33:20.784670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:20.784478    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"
Oct 30 22:33:35.592333 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:33:35.592286    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:33:36.350457 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.350423    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"]
Oct 30 22:33:36.350889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.350871    5967 cpu_manager.go:414] "containerMap: removing container" podUID="9a50574f-7c14-47fc-bfd7-c519c192b310" containerName="revoke-keys"
Oct 30 22:33:36.350889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.350890    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a50574f-7c14-47fc-bfd7-c519c192b310" containerName="revoke-keys"
Oct 30 22:33:36.351066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.351007    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a50574f-7c14-47fc-bfd7-c519c192b310" containerName="revoke-keys"
Oct 30 22:33:36.354420 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.354403    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.377705 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.377680    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.377816 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.377789    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.377868 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.377816    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgkm\" (UniqueName: \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.407003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.406978    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:33:36.456704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.456674    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:33:36.456704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.456697    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:33:36.456892 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.456684    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:33:36.458268 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.458251    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"]
Oct 30 22:33:36.479114 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.479089    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.479282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.479175    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.479282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.479211    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgkm\" (UniqueName: \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.479749 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.479729    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.481762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.481742    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.540775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.540740    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgkm\" (UniqueName: \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\") pod \"maas-api-revoke-sub-8079e8bc-fp4xm\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:36.667016 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:36.666934    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:37.043044 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:37.043016    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"]
Oct 30 22:33:37.045676 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:33:37.045642    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31a9dee_db6f_4f4e_aa24_f30034a495f9.slice/crio-37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a WatchSource:0}: Error finding container 37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a: Status 404 returned error can't find the container with id 37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a
Oct 30 22:33:37.880021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:37.879988    5967 generic.go:356] "Generic (PLEG): container finished" podID="f31a9dee-db6f-4f4e-aa24-f30034a495f9" containerID="698dcc14f600f49e63d171304aecde5930a4d8dc8e11eae29a6b00fb9020db02" exitCode=0
Oct 30 22:33:37.880416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:37.880041    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm" event={"ID":"f31a9dee-db6f-4f4e-aa24-f30034a495f9","Type":"ContainerDied","Data":"698dcc14f600f49e63d171304aecde5930a4d8dc8e11eae29a6b00fb9020db02"}
Oct 30 22:33:37.880416 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:37.880097    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm" event={"ID":"f31a9dee-db6f-4f4e-aa24-f30034a495f9","Type":"ContainerStarted","Data":"37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a"}
Oct 30 22:33:39.023649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.023619    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:39.105950 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.105911    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\") pod \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") "
Oct 30 22:33:39.105950 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.105956    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\") pod \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") "
Oct 30 22:33:39.106160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.106072    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\" (UniqueName: \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\") pod \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\" (UID: \"f31a9dee-db6f-4f4e-aa24-f30034a495f9\") "
Oct 30 22:33:39.106446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.106420    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca" pod "f31a9dee-db6f-4f4e-aa24-f30034a495f9" (UID: "f31a9dee-db6f-4f4e-aa24-f30034a495f9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:39.108948 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.108925    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca" pod "f31a9dee-db6f-4f4e-aa24-f30034a495f9" (UID: "f31a9dee-db6f-4f4e-aa24-f30034a495f9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:39.109022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.108945    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm" pod "f31a9dee-db6f-4f4e-aa24-f30034a495f9" (UID: "f31a9dee-db6f-4f4e-aa24-f30034a495f9"). InnerVolumeSpecName "kube-api-access-6rgkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:39.207186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.207104    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rgkm\" (UniqueName: \"kubernetes.io/projected/f31a9dee-db6f-4f4e-aa24-f30034a495f9-kube-api-access-6rgkm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:39.207186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.207132    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:39.207186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.207141    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f31a9dee-db6f-4f4e-aa24-f30034a495f9-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:39.891591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.891564    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"
Oct 30 22:33:39.891794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.891594    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm" event={"ID":"f31a9dee-db6f-4f4e-aa24-f30034a495f9","Type":"ContainerDied","Data":"37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a"}
Oct 30 22:33:39.891794 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:39.891652    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37153b0935404a6305aab45533631c20162ce39607329cceab4f95639b10dc6a"
Oct 30 22:33:56.844890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.844848    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"]
Oct 30 22:33:56.845362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.845283    5967 cpu_manager.go:414] "containerMap: removing container" podUID="f31a9dee-db6f-4f4e-aa24-f30034a495f9" containerName="revoke-keys"
Oct 30 22:33:56.845362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.845294    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f31a9dee-db6f-4f4e-aa24-f30034a495f9" containerName="revoke-keys"
Oct 30 22:33:56.845468 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.845432    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="f31a9dee-db6f-4f4e-aa24-f30034a495f9" containerName="revoke-keys"
Oct 30 22:33:56.848735 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.848715    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:56.950894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.950853    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:33:56.950894 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.950881    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:33:56.951128 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.950881    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:33:56.951128 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.950914    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:33:56.953493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.953468    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"]
Oct 30 22:33:56.986943 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.986905    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:56.987137 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.987081    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r4zl\" (UniqueName: \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:56.987187 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:56.987145    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.087750 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.087716    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.087940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.087808    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r4zl\" (UniqueName: \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.087940 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.087858    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.088417 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.088364    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.090549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.090524    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.148805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.148736    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r4zl\" (UniqueName: \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\") pod \"maas-api-revoke-keys-e2e-inf-a-026c11-82rrb\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.162624 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.162595    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:33:57.548459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.548431    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"]
Oct 30 22:33:57.983746 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.983708    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb" event={"ID":"ca0a1be2-b338-4aa9-b110-43d74ff488ae","Type":"ContainerStarted","Data":"487d0e49c5fd12aff57ea3d47e6ed56ee4fc4ac2d87355e2141d6459d51cd386"}
Oct 30 22:33:57.984139 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:57.983777    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb" event={"ID":"ca0a1be2-b338-4aa9-b110-43d74ff488ae","Type":"ContainerStarted","Data":"3cb478b6c15d3e0a8ef20fdacb1ddbb70a8f02133b91177315932d71b9da23e1"}
Oct 30 22:33:58.100545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:58.100459    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb" podStartSLOduration=2.100444262 podStartE2EDuration="2.100444262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:58.099592692 +0000 UTC m=+2926.214301044" watchObservedRunningTime="2026-10-30 22:33:58.100444262 +0000 UTC m=+2926.215152613"
Oct 30 22:33:58.996083 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:58.996047    5967 generic.go:356] "Generic (PLEG): container finished" podID="ca0a1be2-b338-4aa9-b110-43d74ff488ae" containerID="487d0e49c5fd12aff57ea3d47e6ed56ee4fc4ac2d87355e2141d6459d51cd386" exitCode=0
Oct 30 22:33:58.996572 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:33:58.996095    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb" event={"ID":"ca0a1be2-b338-4aa9-b110-43d74ff488ae","Type":"ContainerDied","Data":"487d0e49c5fd12aff57ea3d47e6ed56ee4fc4ac2d87355e2141d6459d51cd386"}
Oct 30 22:34:00.134969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.134945    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:34:00.224938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.224907    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\") pod \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") "
Oct 30 22:34:00.225157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.224954    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\" (UniqueName: \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\") pod \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") "
Oct 30 22:34:00.225157 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.225027    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\") pod \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\" (UID: \"ca0a1be2-b338-4aa9-b110-43d74ff488ae\") "
Oct 30 22:34:00.225420 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.225398    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca" pod "ca0a1be2-b338-4aa9-b110-43d74ff488ae" (UID: "ca0a1be2-b338-4aa9-b110-43d74ff488ae"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:00.227103 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.227079    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca" pod "ca0a1be2-b338-4aa9-b110-43d74ff488ae" (UID: "ca0a1be2-b338-4aa9-b110-43d74ff488ae"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:00.227209 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.227156    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl" pod "ca0a1be2-b338-4aa9-b110-43d74ff488ae" (UID: "ca0a1be2-b338-4aa9-b110-43d74ff488ae"). InnerVolumeSpecName "kube-api-access-5r4zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:00.326493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.326416    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:00.326493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.326444    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ca0a1be2-b338-4aa9-b110-43d74ff488ae-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:00.326493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:00.326453    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r4zl\" (UniqueName: \"kubernetes.io/projected/ca0a1be2-b338-4aa9-b110-43d74ff488ae-kube-api-access-5r4zl\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:01.007150 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:01.007122    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"
Oct 30 22:34:01.007332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:01.007162    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb" event={"ID":"ca0a1be2-b338-4aa9-b110-43d74ff488ae","Type":"ContainerDied","Data":"3cb478b6c15d3e0a8ef20fdacb1ddbb70a8f02133b91177315932d71b9da23e1"}
Oct 30 22:34:01.007332 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:01.007214    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb478b6c15d3e0a8ef20fdacb1ddbb70a8f02133b91177315932d71b9da23e1"
Oct 30 22:34:05.592814 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:34:05.592772    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:34:13.457210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:13.457172    5967 scope.go:122] "RemoveContainer" containerID="55f03fa94b812a27c1185967bc7fe3b1073ecc214d2051f1e2c2231340e71414"
Oct 30 22:34:13.466539 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:13.466519    5967 scope.go:122] "RemoveContainer" containerID="4338900040b9425023de9fa9af428649d128070bdcf13b51642418235a85a28c"
Oct 30 22:34:19.843775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:19.843736    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:34:20.397641 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.397606    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"]
Oct 30 22:34:20.398074 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.398060    5967 cpu_manager.go:414] "containerMap: removing container" podUID="ca0a1be2-b338-4aa9-b110-43d74ff488ae" containerName="revoke-keys"
Oct 30 22:34:20.398120 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.398076    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca0a1be2-b338-4aa9-b110-43d74ff488ae" containerName="revoke-keys"
Oct 30 22:34:20.398173 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.398165    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca0a1be2-b338-4aa9-b110-43d74ff488ae" containerName="revoke-keys"
Oct 30 22:34:20.402663 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.402643    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.420383 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.420346    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.420506 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.420410    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.420590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.420570    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5s84\" (UniqueName: \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.454949 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.454921    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:34:20.455116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.455030    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:34:20.455116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.455085    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:34:20.457601 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.457581    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:34:20.506211 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.506179    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"]
Oct 30 22:34:20.521551 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.521522    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.521711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.521596    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.521775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.521752    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5s84\" (UniqueName: \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.522351 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.522327    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.524088 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.524059    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.583113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.583078    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5s84\" (UniqueName: \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\") pod \"maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:20.715927 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:20.715896    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:21.092490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:21.092461    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"]
Oct 30 22:34:21.095230 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:34:21.095202    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b5eec6_3565_40b9_b5c5_f6b1efce581c.slice/crio-4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b WatchSource:0}: Error finding container 4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b: Status 404 returned error can't find the container with id 4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b
Oct 30 22:34:21.112623 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:21.112592    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8" event={"ID":"82b5eec6-3565-40b9-b5c5-f6b1efce581c","Type":"ContainerStarted","Data":"4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b"}
Oct 30 22:34:22.120249 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:22.120212    5967 generic.go:356] "Generic (PLEG): container finished" podID="82b5eec6-3565-40b9-b5c5-f6b1efce581c" containerID="379efe5e4244708caf4e9baf39556a3a40aab213ad88be6e556342e956391ff5" exitCode=0
Oct 30 22:34:22.120681 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:22.120305    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8" event={"ID":"82b5eec6-3565-40b9-b5c5-f6b1efce581c","Type":"ContainerDied","Data":"379efe5e4244708caf4e9baf39556a3a40aab213ad88be6e556342e956391ff5"}
Oct 30 22:34:23.279597 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.279569    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:23.351258 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.351228    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\" (UniqueName: \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\") pod \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") "
Oct 30 22:34:23.351492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.351309    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\") pod \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") "
Oct 30 22:34:23.351492 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.351467    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\") pod \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\" (UID: \"82b5eec6-3565-40b9-b5c5-f6b1efce581c\") "
Oct 30 22:34:23.351849 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.351814    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca" pod "82b5eec6-3565-40b9-b5c5-f6b1efce581c" (UID: "82b5eec6-3565-40b9-b5c5-f6b1efce581c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:23.353637 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.353615    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca" pod "82b5eec6-3565-40b9-b5c5-f6b1efce581c" (UID: "82b5eec6-3565-40b9-b5c5-f6b1efce581c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:23.353721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.353632    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84" pod "82b5eec6-3565-40b9-b5c5-f6b1efce581c" (UID: "82b5eec6-3565-40b9-b5c5-f6b1efce581c"). InnerVolumeSpecName "kube-api-access-t5s84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:23.452958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.452873    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:23.452958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.452905    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5s84\" (UniqueName: \"kubernetes.io/projected/82b5eec6-3565-40b9-b5c5-f6b1efce581c-kube-api-access-t5s84\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:23.452958 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:23.452915    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/82b5eec6-3565-40b9-b5c5-f6b1efce581c-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:24.131746 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:24.131719    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"
Oct 30 22:34:24.131943 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:24.131761    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8" event={"ID":"82b5eec6-3565-40b9-b5c5-f6b1efce581c","Type":"ContainerDied","Data":"4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b"}
Oct 30 22:34:24.131943 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:24.131805    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cb6b5b872936ca6264ba0204c0f622691f0135455a7b9357d882fc3d8a5087b"
Oct 30 22:34:34.865840 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:34.865796    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" podUID="dabc7d76-1725-4b90-88ec-f9889ca298c0" containerName="main" containerID="cri-o://59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565" gracePeriod=45
Oct 30 22:34:35.125453 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.125395    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:34:35.186092 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.186058    5967 generic.go:356] "Generic (PLEG): container finished" podID="dabc7d76-1725-4b90-88ec-f9889ca298c0" containerID="59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565" exitCode=0
Oct 30 22:34:35.186276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.186102    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"
Oct 30 22:34:35.186276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.186135    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" event={"ID":"dabc7d76-1725-4b90-88ec-f9889ca298c0","Type":"ContainerDied","Data":"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"}
Oct 30 22:34:35.186276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.186181    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm" event={"ID":"dabc7d76-1725-4b90-88ec-f9889ca298c0","Type":"ContainerDied","Data":"bd179b5509eb197bcf594f4db3eaa03d355753500721dc65ac7a9092fbf720b9"}
Oct 30 22:34:35.186276 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.186201    5967 scope.go:122] "RemoveContainer" containerID="59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"
Oct 30 22:34:35.194690 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.194664    5967 scope.go:122] "RemoveContainer" containerID="59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"
Oct 30 22:34:35.194994 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:34:35.194974    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565\": container with ID starting with 59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565 not found: ID does not exist" containerID="59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"
Oct 30 22:34:35.195057 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.195022    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565"} err="failed to get container status \"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565\": rpc error: code = NotFound desc = could not find container \"59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565\": container with ID starting with 59913c68b86d399fdbec1d070d510e5c1b8f128ff44501e19e5c5e31e1130565 not found: ID does not exist"
Oct 30 22:34:35.272139 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272097    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\" (UniqueName: \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272345 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272154    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272345 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272263    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\" (UniqueName: \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272345 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272330    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272566 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272366    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272566 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272444    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\") pod \"dabc7d76-1725-4b90-88ec-f9889ca298c0\" (UID: \"dabc7d76-1725-4b90-88ec-f9889ca298c0\") "
Oct 30 22:34:35.272698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272641    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:35.272759 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272708    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:35.272888 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272858    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.273029 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272891    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.273029 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.272870    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:35.274779 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.274751    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:35.274892 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.274799    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:35.274892 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.274836    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j" pod "dabc7d76-1725-4b90-88ec-f9889ca298c0" (UID: "dabc7d76-1725-4b90-88ec-f9889ca298c0"). InnerVolumeSpecName "kube-api-access-l2t4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:35.374301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.374265    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2t4j\" (UniqueName: \"kubernetes.io/projected/dabc7d76-1725-4b90-88ec-f9889ca298c0-kube-api-access-l2t4j\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.374301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.374298    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.374301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.374310    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dabc7d76-1725-4b90-88ec-f9889ca298c0-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.374561 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.374320    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dabc7d76-1725-4b90-88ec-f9889ca298c0-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:35.591838 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:34:35.591803    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:34:35.621522 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.621424    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:34:35.641015 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:35.624067    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c04440/test-model-c04440-kserve-56676cf68f-lhltm"]
Oct 30 22:34:36.017779 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:36.017743    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dabc7d76-1725-4b90-88ec-f9889ca298c0" path="/var/lib/kubelet/pods/dabc7d76-1725-4b90-88ec-f9889ca298c0/volumes"
Oct 30 22:34:49.139144 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:49.139113    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"]
Oct 30 22:34:49.188762 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:49.188727    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-87b6b3-2fxp8"]
Oct 30 22:34:50.017355 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:50.017308    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82b5eec6-3565-40b9-b5c5-f6b1efce581c" path="/var/lib/kubelet/pods/82b5eec6-3565-40b9-b5c5-f6b1efce581c/volumes"
Oct 30 22:34:50.275342 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:50.275264    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"]
Oct 30 22:34:50.324787 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:50.324736    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-026c11-82rrb"]
Oct 30 22:34:52.017282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:52.017184    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca0a1be2-b338-4aa9-b110-43d74ff488ae" path="/var/lib/kubelet/pods/ca0a1be2-b338-4aa9-b110-43d74ff488ae/volumes"
Oct 30 22:34:57.000775 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.000736    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"]
Oct 30 22:34:57.001211 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001174    5967 cpu_manager.go:414] "containerMap: removing container" podUID="dabc7d76-1725-4b90-88ec-f9889ca298c0" containerName="main"
Oct 30 22:34:57.001211 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001185    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dabc7d76-1725-4b90-88ec-f9889ca298c0" containerName="main"
Oct 30 22:34:57.001299 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001213    5967 cpu_manager.go:414] "containerMap: removing container" podUID="82b5eec6-3565-40b9-b5c5-f6b1efce581c" containerName="revoke-keys"
Oct 30 22:34:57.001299 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001219    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82b5eec6-3565-40b9-b5c5-f6b1efce581c" containerName="revoke-keys"
Oct 30 22:34:57.001299 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001290    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="dabc7d76-1725-4b90-88ec-f9889ca298c0" containerName="main"
Oct 30 22:34:57.001464 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.001304    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="82b5eec6-3565-40b9-b5c5-f6b1efce581c" containerName="revoke-keys"
Oct 30 22:34:57.005600 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.005579    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.061939 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.061904    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"]
Oct 30 22:34:57.082408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.082358    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.082585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.082466    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.082585 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.082541    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcwds\" (UniqueName: \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.109704 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.109665    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:34:57.109852 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.109722    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:34:57.109852 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.109736    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:34:57.109852 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.109835    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:34:57.183434 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.183404    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.183455    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.183695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.183492    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcwds\" (UniqueName: \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.184051 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.184018    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.185995 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.185972    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.249445 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.249406    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcwds\" (UniqueName: \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\") pod \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.318286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.318203    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:34:57.692836 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:57.692710    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"]
Oct 30 22:34:57.695208 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:34:57.695169    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06f7066_1c5f_44c3_bc4b_32af660647c3.slice/crio-b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558 WatchSource:0}: Error finding container b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558: Status 404 returned error can't find the container with id b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558
Oct 30 22:34:58.296984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:58.296902    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7" event={"ID":"b06f7066-1c5f-44c3-bc4b-32af660647c3","Type":"ContainerStarted","Data":"9248d29a72491edf2a6df3fc13132234299add83fee05d173da0c0242ad606f0"}
Oct 30 22:34:58.296984 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:58.296956    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7" event={"ID":"b06f7066-1c5f-44c3-bc4b-32af660647c3","Type":"ContainerStarted","Data":"b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558"}
Oct 30 22:34:58.412362 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:58.412302    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7" podStartSLOduration=2.412287107 podStartE2EDuration="2.412287107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:58.411531026 +0000 UTC m=+2986.526239379" watchObservedRunningTime="2026-10-30 22:34:58.412287107 +0000 UTC m=+2986.526995458"
Oct 30 22:34:59.303661 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:59.303623    5967 generic.go:356] "Generic (PLEG): container finished" podID="b06f7066-1c5f-44c3-bc4b-32af660647c3" containerID="9248d29a72491edf2a6df3fc13132234299add83fee05d173da0c0242ad606f0" exitCode=0
Oct 30 22:34:59.304138 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:34:59.303672    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7" event={"ID":"b06f7066-1c5f-44c3-bc4b-32af660647c3","Type":"ContainerDied","Data":"9248d29a72491edf2a6df3fc13132234299add83fee05d173da0c0242ad606f0"}
Oct 30 22:35:00.445066 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.445039    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:35:00.517616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.517583    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\") pod \"b06f7066-1c5f-44c3-bc4b-32af660647c3\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") "
Oct 30 22:35:00.517616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.517621    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\" (UniqueName: \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\") pod \"b06f7066-1c5f-44c3-bc4b-32af660647c3\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") "
Oct 30 22:35:00.517867 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.517677    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\") pod \"b06f7066-1c5f-44c3-bc4b-32af660647c3\" (UID: \"b06f7066-1c5f-44c3-bc4b-32af660647c3\") "
Oct 30 22:35:00.518097 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.518070    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca" pod "b06f7066-1c5f-44c3-bc4b-32af660647c3" (UID: "b06f7066-1c5f-44c3-bc4b-32af660647c3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:00.519821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.519800    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca" pod "b06f7066-1c5f-44c3-bc4b-32af660647c3" (UID: "b06f7066-1c5f-44c3-bc4b-32af660647c3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:00.519890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.519876    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds" pod "b06f7066-1c5f-44c3-bc4b-32af660647c3" (UID: "b06f7066-1c5f-44c3-bc4b-32af660647c3"). InnerVolumeSpecName "kube-api-access-jcwds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:00.619344 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.619266    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.619344 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.619295    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b06f7066-1c5f-44c3-bc4b-32af660647c3-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.619344 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:00.619305    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcwds\" (UniqueName: \"kubernetes.io/projected/b06f7066-1c5f-44c3-bc4b-32af660647c3-kube-api-access-jcwds\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:01.314384 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:01.314350    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:35:01.314546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:01.314393    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7" event={"ID":"b06f7066-1c5f-44c3-bc4b-32af660647c3","Type":"ContainerDied","Data":"b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558"}
Oct 30 22:35:01.314546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:01.314445    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b36bf9aa25340d2e7421edaf289023066513ace109f653aedb773e3346ac1558"
Oct 30 22:35:05.594295 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:35:05.594258    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:35:15.360864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:15.360841    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:35:15.381657 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:15.381627    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:35:22.006711 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:22.006623    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"]
Oct 30 22:35:22.056547 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:22.056512    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"]
Oct 30 22:35:22.064745 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:35:22.064712    5967 status_manager.go:1045] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-inf-b-c04440-v26m7\" is forbidden: User \"system:node:ip-10-0-130-176.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-176.us-west-1.compute.internal' and this object" podUID="b06f7066-1c5f-44c3-bc4b-32af660647c3" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c04440-v26m7"
Oct 30 22:35:24.024479 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:24.024434    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b06f7066-1c5f-44c3-bc4b-32af660647c3" path="/var/lib/kubelet/pods/b06f7066-1c5f-44c3-bc4b-32af660647c3/volumes"
Oct 30 22:35:35.545110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:35.545074    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:35:35.592865 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:35:35.592833    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:35:35.680893 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:35.680853    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:35:49.484573 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.484537    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"]
Oct 30 22:35:49.485000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.484972    5967 cpu_manager.go:414] "containerMap: removing container" podUID="b06f7066-1c5f-44c3-bc4b-32af660647c3" containerName="revoke-keys"
Oct 30 22:35:49.485000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.484983    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b06f7066-1c5f-44c3-bc4b-32af660647c3" containerName="revoke-keys"
Oct 30 22:35:49.485104 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.485090    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="b06f7066-1c5f-44c3-bc4b-32af660647c3" containerName="revoke-keys"
Oct 30 22:35:49.488579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.488558    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.589460 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.589422    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"]
Oct 30 22:35:49.594241 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.594217    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:35:49.594452 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.594276    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:35:49.594564 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.594530    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:35:49.594695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.594569    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:35:49.607278 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.607247    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.607472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.607282    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.607472 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.607411    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncs8w\" (UniqueName: \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.708427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.708363    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.708427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.708429    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.708702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.708479    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncs8w\" (UniqueName: \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.709086 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.709057    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.710890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.710870    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.770405 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.770310    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncs8w\" (UniqueName: \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\") pod \"maas-api-revoke-sub-bc5a4223-2czv9\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:49.801698 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:49.801670    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:50.177800 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.177742    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"]
Oct 30 22:35:50.180669 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:35:50.180637    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3fd503_ee9d_49e9_82da_b1b0f413670c.slice/crio-c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68 WatchSource:0}: Error finding container c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68: Status 404 returned error can't find the container with id c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68
Oct 30 22:35:50.555726 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.555697    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9" event={"ID":"3a3fd503-ee9d-49e9-82da-b1b0f413670c","Type":"ContainerStarted","Data":"ca2fead9c57f2c17e8b93d85c6bfea7346b768d346936c4104077289853b5c28"}
Oct 30 22:35:50.556118 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.555750    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9" event={"ID":"3a3fd503-ee9d-49e9-82da-b1b0f413670c","Type":"ContainerStarted","Data":"c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68"}
Oct 30 22:35:50.567175 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.567144    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" containerID="cri-o://bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f" gracePeriod=45
Oct 30 22:35:50.672259 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.672182    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9" podStartSLOduration=1.672165493 podStartE2EDuration="1.672165493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:35:50.672101937 +0000 UTC m=+3038.786810291" watchObservedRunningTime="2026-10-30 22:35:50.672165493 +0000 UTC m=+3038.786873843"
Oct 30 22:35:50.701439 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.701401    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main" containerID="cri-o://6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295" gracePeriod=45
Oct 30 22:35:50.827968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.827939    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:35:50.920130 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920096    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920165    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\" (UniqueName: \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920230    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920281 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920269    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920350    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920437    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.920463 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920453    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\" (UniqueName: \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\") pod \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\" (UID: \"e08636c0-2ce2-469a-a1c8-5d2dc97770b6\") "
Oct 30 22:35:50.920625 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920577    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.920848 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920803    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:50.920848 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920825    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:50.921003 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.920863    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.923606 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.923583    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:50.923715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.923617    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "kube-api-access-bmtbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:50.923715 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.923708    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm" pod "e08636c0-2ce2-469a-a1c8-5d2dc97770b6" (UID: "e08636c0-2ce2-469a-a1c8-5d2dc97770b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.950436 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:50.950415    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:35:51.021666 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021574    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.021666 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021630    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.021898 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021694    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\" (UniqueName: \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.021898 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021777    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.021898 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021842    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.022067 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.021896    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\") pod \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\" (UID: \"3d3d26b8-e5bb-4753-8aa9-0830623104e2\") "
Oct 30 22:35:51.022221 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022197    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmtbx\" (UniqueName: \"kubernetes.io/projected/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-kube-api-access-bmtbx\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.022294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022230    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.022294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022245    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.022294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022257    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e08636c0-2ce2-469a-a1c8-5d2dc97770b6-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.022479 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022345    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:51.022536 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022477    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:51.022736 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.022710    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:51.024053 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.024022    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "kube-api-access-dxr89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:51.024158 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.024060    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:51.024538 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.024514    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm" pod "3d3d26b8-e5bb-4753-8aa9-0830623104e2" (UID: "3d3d26b8-e5bb-4753-8aa9-0830623104e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:51.123314 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123284    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.123314 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123311    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.123545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123323    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d3d26b8-e5bb-4753-8aa9-0830623104e2-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.123545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123334    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.123545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123347    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxr89\" (UniqueName: \"kubernetes.io/projected/3d3d26b8-e5bb-4753-8aa9-0830623104e2-kube-api-access-dxr89\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.123545 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.123359    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d3d26b8-e5bb-4753-8aa9-0830623104e2-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.562593 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.562563    5967 generic.go:356] "Generic (PLEG): container finished" podID="3a3fd503-ee9d-49e9-82da-b1b0f413670c" containerID="ca2fead9c57f2c17e8b93d85c6bfea7346b768d346936c4104077289853b5c28" exitCode=0
Oct 30 22:35:51.563006 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.562650    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9" event={"ID":"3a3fd503-ee9d-49e9-82da-b1b0f413670c","Type":"ContainerDied","Data":"ca2fead9c57f2c17e8b93d85c6bfea7346b768d346936c4104077289853b5c28"}
Oct 30 22:35:51.564025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.564003    5967 generic.go:356] "Generic (PLEG): container finished" podID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerID="bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f" exitCode=0
Oct 30 22:35:51.564153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.564039    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"
Oct 30 22:35:51.564153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.564097    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" event={"ID":"e08636c0-2ce2-469a-a1c8-5d2dc97770b6","Type":"ContainerDied","Data":"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"}
Oct 30 22:35:51.564153 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.564139    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" event={"ID":"e08636c0-2ce2-469a-a1c8-5d2dc97770b6","Type":"ContainerDied","Data":"c65b223b79cd10c8087045dd1c2f787495f37b1f0bac36554e85f738b16639cc"}
Oct 30 22:35:51.564315 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.564157    5967 scope.go:122] "RemoveContainer" containerID="bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"
Oct 30 22:35:51.565476 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.565451    5967 generic.go:356] "Generic (PLEG): container finished" podID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerID="6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295" exitCode=0
Oct 30 22:35:51.565599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.565488    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" event={"ID":"3d3d26b8-e5bb-4753-8aa9-0830623104e2","Type":"ContainerDied","Data":"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"}
Oct 30 22:35:51.565599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.565496    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"
Oct 30 22:35:51.565599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.565516    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22" event={"ID":"3d3d26b8-e5bb-4753-8aa9-0830623104e2","Type":"ContainerDied","Data":"0e7be95cb21634cc41ca67f02a3951a98db0de34efb4c868874c3c3314660578"}
Oct 30 22:35:51.573862 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.573845    5967 scope.go:122] "RemoveContainer" containerID="bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"
Oct 30 22:35:51.574104 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:35:51.574085    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f\": container with ID starting with bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f not found: ID does not exist" containerID="bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"
Oct 30 22:35:51.574177 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.574116    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f"} err="failed to get container status \"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f\": rpc error: code = NotFound desc = could not find container \"bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f\": container with ID starting with bae9a1768797a256cb76a15cb38dc3fc328125dc06565b97566d91964042351f not found: ID does not exist"
Oct 30 22:35:51.574177 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.574139    5967 scope.go:122] "RemoveContainer" containerID="6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"
Oct 30 22:35:51.582235 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.582219    5967 scope.go:122] "RemoveContainer" containerID="6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"
Oct 30 22:35:51.582493 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:35:51.582474    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295\": container with ID starting with 6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295 not found: ID does not exist" containerID="6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"
Oct 30 22:35:51.582546 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.582500    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295"} err="failed to get container status \"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295\": rpc error: code = NotFound desc = could not find container \"6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295\": container with ID starting with 6afcb569191f8f6b6209999f26a4efc1601ca7a24244b682413f912bb0fdb295 not found: ID does not exist"
Oct 30 22:35:51.787954 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.787903    5967 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:35:51.789793 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.789769    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:35:51.794304 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.794282    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/simulator-w6-b9fbe2-kserve-7fbdbf94c5-wfn22"]
Oct 30 22:35:51.903270 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.903194    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:35:51.906977 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:51.906951    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-2-w6-b9fbe2-kserve-dd74b4fc4-rxdbm"]
Oct 30 22:35:52.016578 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.016546    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" path="/var/lib/kubelet/pods/3d3d26b8-e5bb-4753-8aa9-0830623104e2/volumes"
Oct 30 22:35:52.016960 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.016946    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" path="/var/lib/kubelet/pods/e08636c0-2ce2-469a-a1c8-5d2dc97770b6/volumes"
Oct 30 22:35:52.709324 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.709294    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:52.839695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.839617    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\" (UniqueName: \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\") pod \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") "
Oct 30 22:35:52.839695 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.839654    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\") pod \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") "
Oct 30 22:35:52.839928 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.839813    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\") pod \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\" (UID: \"3a3fd503-ee9d-49e9-82da-b1b0f413670c\") "
Oct 30 22:35:52.840040 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.840017    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca" pod "3a3fd503-ee9d-49e9-82da-b1b0f413670c" (UID: "3a3fd503-ee9d-49e9-82da-b1b0f413670c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:52.842022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.841996    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w" pod "3a3fd503-ee9d-49e9-82da-b1b0f413670c" (UID: "3a3fd503-ee9d-49e9-82da-b1b0f413670c"). InnerVolumeSpecName "kube-api-access-ncs8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:52.842022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.842006    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca" pod "3a3fd503-ee9d-49e9-82da-b1b0f413670c" (UID: "3a3fd503-ee9d-49e9-82da-b1b0f413670c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:52.940583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.940550    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:52.940583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.940578    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncs8w\" (UniqueName: \"kubernetes.io/projected/3a3fd503-ee9d-49e9-82da-b1b0f413670c-kube-api-access-ncs8w\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:52.940583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:52.940588    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3a3fd503-ee9d-49e9-82da-b1b0f413670c-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:53.577926 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:53.577893    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"
Oct 30 22:35:53.577926 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:53.577906    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9" event={"ID":"3a3fd503-ee9d-49e9-82da-b1b0f413670c","Type":"ContainerDied","Data":"c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68"}
Oct 30 22:35:53.578148 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:35:53.577962    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8957e9740cead89c345312e9550e3b4ce96732b6bb2074c74c21687eefdbe68"
Oct 30 22:36:05.593055 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:36:05.593015    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:36:35.591998 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:36:35.591961    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:37:02.052970 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:02.052925    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:37:05.593061 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:37:05.593024    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:37:08.809286 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809242    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"]
Oct 30 22:37:08.809881 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809860    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main"
Oct 30 22:37:08.809969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809884    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main"
Oct 30 22:37:08.809969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809911    5967 cpu_manager.go:414] "containerMap: removing container" podUID="3a3fd503-ee9d-49e9-82da-b1b0f413670c" containerName="revoke-keys"
Oct 30 22:37:08.809969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809919    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a3fd503-ee9d-49e9-82da-b1b0f413670c" containerName="revoke-keys"
Oct 30 22:37:08.809969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809942    5967 cpu_manager.go:414] "containerMap: removing container" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main"
Oct 30 22:37:08.809969 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.809949    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main"
Oct 30 22:37:08.810223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.810071    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="e08636c0-2ce2-469a-a1c8-5d2dc97770b6" containerName="main"
Oct 30 22:37:08.810223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.810094    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d3d26b8-e5bb-4753-8aa9-0830623104e2" containerName="main"
Oct 30 22:37:08.810223 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.810107    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a3fd503-ee9d-49e9-82da-b1b0f413670c" containerName="revoke-keys"
Oct 30 22:37:08.813621 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.813601    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.866475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.866432    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.866475 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.866476    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.866728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.866613    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssrxv\" (UniqueName: \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.871289 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.871255    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"]
Oct 30 22:37:08.918021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.917988    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:37:08.918227 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.918207    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:37:08.918282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.918227    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n567f\""
Oct 30 22:37:08.918282 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.918217    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:37:08.967283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.967251    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssrxv\" (UniqueName: \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.967549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.967327    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.967549 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.967356    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.967976 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.967951    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:08.969955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:08.969926    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:09.028579 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:09.028549    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssrxv\" (UniqueName: \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\") pod \"maas-api-revoke-sub-d134d9eb-zv6bq\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:09.126425 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:09.126345    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:09.498163 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:09.498137    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"]
Oct 30 22:37:09.500845 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:37:09.500808    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274ae568_7b03_4864_9ae7_374002c7b69d.slice/crio-859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6 WatchSource:0}: Error finding container 859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6: Status 404 returned error can't find the container with id 859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6
Oct 30 22:37:09.952925 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:09.952889    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq" event={"ID":"274ae568-7b03-4864-9ae7-374002c7b69d","Type":"ContainerStarted","Data":"13e66204e7106b38af9a46d94efd97e7fc92bb89d4d0e95bba507fc89d29af15"}
Oct 30 22:37:09.953323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:09.952955    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq" event={"ID":"274ae568-7b03-4864-9ae7-374002c7b69d","Type":"ContainerStarted","Data":"859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6"}
Oct 30 22:37:10.069962 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:10.069859    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq" podStartSLOduration=2.069841824 podStartE2EDuration="2.069841824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:37:10.069014769 +0000 UTC m=+3118.183723112" watchObservedRunningTime="2026-10-30 22:37:10.069841824 +0000 UTC m=+3118.184550174"
Oct 30 22:37:10.959701 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:10.959665    5967 generic.go:356] "Generic (PLEG): container finished" podID="274ae568-7b03-4864-9ae7-374002c7b69d" containerID="13e66204e7106b38af9a46d94efd97e7fc92bb89d4d0e95bba507fc89d29af15" exitCode=0
Oct 30 22:37:10.960116 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:10.959742    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq" event={"ID":"274ae568-7b03-4864-9ae7-374002c7b69d","Type":"ContainerDied","Data":"13e66204e7106b38af9a46d94efd97e7fc92bb89d4d0e95bba507fc89d29af15"}
Oct 30 22:37:12.100886 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.100855    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:12.198649 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.198617    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\" (UniqueName: \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\") pod \"274ae568-7b03-4864-9ae7-374002c7b69d\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") "
Oct 30 22:37:12.198821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.198697    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\") pod \"274ae568-7b03-4864-9ae7-374002c7b69d\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") "
Oct 30 22:37:12.198821 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.198800    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\") pod \"274ae568-7b03-4864-9ae7-374002c7b69d\" (UID: \"274ae568-7b03-4864-9ae7-374002c7b69d\") "
Oct 30 22:37:12.199030 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.199007    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca" pod "274ae568-7b03-4864-9ae7-374002c7b69d" (UID: "274ae568-7b03-4864-9ae7-374002c7b69d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:12.199122 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.199109    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-openshift-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:12.200968 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.200939    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca" pod "274ae568-7b03-4864-9ae7-374002c7b69d" (UID: "274ae568-7b03-4864-9ae7-374002c7b69d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:37:12.201098 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.201045    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv" pod "274ae568-7b03-4864-9ae7-374002c7b69d" (UID: "274ae568-7b03-4864-9ae7-374002c7b69d"). InnerVolumeSpecName "kube-api-access-ssrxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:12.299890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.299809    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssrxv\" (UniqueName: \"kubernetes.io/projected/274ae568-7b03-4864-9ae7-374002c7b69d-kube-api-access-ssrxv\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:12.299890 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.299840    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/274ae568-7b03-4864-9ae7-374002c7b69d-maas-api-xks-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:12.971449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.971416    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"
Oct 30 22:37:12.971627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.971438    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq" event={"ID":"274ae568-7b03-4864-9ae7-374002c7b69d","Type":"ContainerDied","Data":"859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6"}
Oct 30 22:37:12.971627 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:12.971492    5967 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="859ef893d94a37ae72b8d1595f7ee7023ea689f0abf0dfab5630a6f66f4409a6"
Oct 30 22:37:17.073668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.073608    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main" containerID="cri-o://a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d" gracePeriod=45
Oct 30 22:37:17.321243 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.321218    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:37:17.446611 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446533    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\" (UniqueName: \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.446611 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446594    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.446818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446624    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.446818 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446797    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.446922 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446884    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\" (UniqueName: \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.446922 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446866    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:17.447023 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.446916    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:17.447023 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.447003    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\") pod \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\" (UID: \"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23\") "
Oct 30 22:37:17.447334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.447285    5967 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tmp-dir\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:17.447334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.447283    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:17.447334 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.447308    5967 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-home\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:17.450096 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.450067    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:17.450949 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.450925    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:37:17.457607 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.457486    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd" pod "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" (UID: "2161a16b-a2e9-46c5-9a32-37ee8e0d0c23"). InnerVolumeSpecName "kube-api-access-hwpbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:17.547953 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.547913    5967 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-tls-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:17.547953 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.547954    5967 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-model-cache\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:17.548210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.547969    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwpbd\" (UniqueName: \"kubernetes.io/projected/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-kube-api-access-hwpbd\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:17.548210 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:17.547985    5967 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23-dshm\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:18.003265 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.003233    5967 generic.go:356] "Generic (PLEG): container finished" podID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerID="a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d" exitCode=0
Oct 30 22:37:18.003493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.003290    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"
Oct 30 22:37:18.003493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.003324    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" event={"ID":"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23","Type":"ContainerDied","Data":"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"}
Oct 30 22:37:18.003493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.003380    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll" event={"ID":"2161a16b-a2e9-46c5-9a32-37ee8e0d0c23","Type":"ContainerDied","Data":"3a5d314df5778e9087cb804b5cc784029b4e0a1385b3514d2684baa4ea505ec8"}
Oct 30 22:37:18.003493 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.003394    5967 scope.go:122] "RemoveContainer" containerID="a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"
Oct 30 22:37:18.013791 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.013772    5967 scope.go:122] "RemoveContainer" containerID="a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"
Oct 30 22:37:18.014036 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:37:18.014016    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d\": container with ID starting with a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d not found: ID does not exist" containerID="a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"
Oct 30 22:37:18.014089 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.014044    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d"} err="failed to get container status \"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d\": rpc error: code = NotFound desc = could not find container \"a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d\": container with ID starting with a7d20b86068e80ac5dee931611ca0ed62c64329819857ef9b5e7c1a1c9e5fe4d not found: ID does not exist"
Oct 30 22:37:18.167702 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.167667    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:37:18.217404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:18.217362    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-536975/distinct-w4-536975-kserve-69c5f6f7d4-927ll"]
Oct 30 22:37:20.016913 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:37:20.016877    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" path="/var/lib/kubelet/pods/2161a16b-a2e9-46c5-9a32-37ee8e0d0c23/volumes"
Oct 30 22:37:35.590897 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:37:35.590859    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:38:05.591425 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:38:05.591351    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:38:07.049947 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:07.049909    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"]
Oct 30 22:38:07.053016 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:07.052991    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e2f0c9e2-8qrbt"]
Oct 30 22:38:08.016905 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:08.016871    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="297d6175-0570-41bd-8627-de53d307f3ea" path="/var/lib/kubelet/pods/297d6175-0570-41bd-8627-de53d307f3ea/volumes"
Oct 30 22:38:21.054878 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:21.054840    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"]
Oct 30 22:38:21.104160 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:21.104129    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d61257e3-r5v7t"]
Oct 30 22:38:22.016823 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:22.016794    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a50574f-7c14-47fc-bfd7-c519c192b310" path="/var/lib/kubelet/pods/9a50574f-7c14-47fc-bfd7-c519c192b310/volumes"
Oct 30 22:38:35.592609 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:38:35.592566    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:38:40.049866 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:40.049828    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"]
Oct 30 22:38:40.098569 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:40.098534    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8079e8bc-fp4xm"]
Oct 30 22:38:42.018918 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:38:42.018881    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f31a9dee-db6f-4f4e-aa24-f30034a495f9" path="/var/lib/kubelet/pods/f31a9dee-db6f-4f4e-aa24-f30034a495f9/volumes"
Oct 30 22:39:05.591023 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:39:05.590989    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:39:13.545964 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:39:13.545925    5967 scope.go:122] "RemoveContainer" containerID="b7d23b2c8de10d186aa59e884d93de475f2ec410da08d9e10acdef4d19b6a962"
Oct 30 22:39:35.592333 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:39:35.592297    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:40:01.079257 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079222    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"]
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079653    5967 cpu_manager.go:414] "containerMap: removing container" podUID="274ae568-7b03-4864-9ae7-374002c7b69d" containerName="revoke-keys"
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079665    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="274ae568-7b03-4864-9ae7-374002c7b69d" containerName="revoke-keys"
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079689    5967 cpu_manager.go:414] "containerMap: removing container" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main"
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079695    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main"
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079767    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="2161a16b-a2e9-46c5-9a32-37ee8e0d0c23" containerName="main"
Oct 30 22:40:01.079784 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.079781    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="274ae568-7b03-4864-9ae7-374002c7b69d" containerName="revoke-keys"
Oct 30 22:40:01.083025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.083008    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233630 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233594    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233635    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233721    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233748    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjntd\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-kube-api-access-sjntd\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233805 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233775    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233834    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233884    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04dec749-af2d-451c-a2bf-840b7f2816f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233906    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.233938 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.233931    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335011 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.334922    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335019    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335045    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335076    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335104    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjntd\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-kube-api-access-sjntd\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335140    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335186 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335174    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335211    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04dec749-af2d-451c-a2bf-840b7f2816f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335236    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335389    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335556 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335424    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335747 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335564    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335747 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335668    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.335913 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.335891    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04dec749-af2d-451c-a2bf-840b7f2816f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.337528 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.337508    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.337670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.337652    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.378685 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.378654    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"]
Oct 30 22:40:01.400095 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.400067    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.400312 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.400292    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjntd\" (UniqueName: \"kubernetes.io/projected/04dec749-af2d-451c-a2bf-840b7f2816f3-kube-api-access-sjntd\") pod \"maas-default-gateway-openshift-default-6cc458d887-dvp9t\" (UID: \"04dec749-af2d-451c-a2bf-840b7f2816f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:01.696064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:01.695970    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:02.125171 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.125113    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"]
Oct 30 22:40:02.127572 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:40:02.127546    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04dec749_af2d_451c_a2bf_840b7f2816f3.slice/crio-425ed608b1b1a58ccf6d70952cd17a008f6722a2e8276d7598afb885a1533f2f WatchSource:0}: Error finding container 425ed608b1b1a58ccf6d70952cd17a008f6722a2e8276d7598afb885a1533f2f: Status 404 returned error can't find the container with id 425ed608b1b1a58ccf6d70952cd17a008f6722a2e8276d7598afb885a1533f2f
Oct 30 22:40:02.129678 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.129642    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:02.129783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.129722    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:02.129783 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.129768    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:02.819893 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.819857    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" event={"ID":"04dec749-af2d-451c-a2bf-840b7f2816f3","Type":"ContainerStarted","Data":"f87ca2a9f6797d279548725c684defeed9f93b352a3ec5b9e96da0c59bfb58c6"}
Oct 30 22:40:02.820075 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.819910    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" event={"ID":"04dec749-af2d-451c-a2bf-840b7f2816f3","Type":"ContainerStarted","Data":"425ed608b1b1a58ccf6d70952cd17a008f6722a2e8276d7598afb885a1533f2f"}
Oct 30 22:40:02.999404 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:02.993255    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podStartSLOduration=1.9932339799999998 podStartE2EDuration="1.99323398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:02.991020896 +0000 UTC m=+3291.105729260" watchObservedRunningTime="2026-10-30 22:40:02.99323398 +0000 UTC m=+3291.107942332"
Oct 30 22:40:03.703396 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:03.697737    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:03.704523 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:03.704491    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:03.704771 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:03.704744    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:04.701870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:04.701831    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:04.702164 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:04.702134    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:05.612198 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:40:05.612158    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:40:05.701399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:05.698849    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:05.701399 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:05.698916    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:06.698408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:06.697821    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:06.698408 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:06.697887    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:07.699779 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:07.699739    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:07.700442 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:07.700341    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:08.697197 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:08.697157    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dvp9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused" start-of-body=
Oct 30 22:40:08.697427 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:08.697228    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t" podUID="04dec749-af2d-451c-a2bf-840b7f2816f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.109:15021/healthz/ready\": dial tcp 10.134.0.109:15021: connect: connection refused"
Oct 30 22:40:10.298891 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:10.298851    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:10.299443 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:10.299264    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:10.300104 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:10.300084    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dvp9t"
Oct 30 22:40:13.568156 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:13.568127    5967 scope.go:122] "RemoveContainer" containerID="487d0e49c5fd12aff57ea3d47e6ed56ee4fc4ac2d87355e2141d6459d51cd386"
Oct 30 22:40:13.576972 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:13.576939    5967 scope.go:122] "RemoveContainer" containerID="698dcc14f600f49e63d171304aecde5930a4d8dc8e11eae29a6b00fb9020db02"
Oct 30 22:40:13.585008 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:13.584989    5967 scope.go:122] "RemoveContainer" containerID="95a8633ce888c12ca2bba2e7cbfc14eaab1410a580ca84c1e68de15b22adf75c"
Oct 30 22:40:15.392909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:15.392876    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:40:15.416294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:15.416269    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:40:16.206266 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.206234    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"]
Oct 30 22:40:16.211365 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.211346    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286302 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286264    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286302 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286302    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286337    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286599 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286492    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286714 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286591    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mswh5\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-kube-api-access-mswh5\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286714 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286651    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286827 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286733    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286827 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286799    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.286930 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.286832    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.320178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.320142    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"]
Oct 30 22:40:16.387532 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387502    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387552    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387676    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387730    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387761    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387794    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.387855 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387834    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387881    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mswh5\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-kube-api-access-mswh5\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387908    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388064 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.387927    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.388143    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388213 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.388178    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.388255    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.388323 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.388301    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.390351 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.390329    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.390516 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.390486    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.451679 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.451652    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.452024 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.451745    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mswh5\" (UniqueName: \"kubernetes.io/projected/34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9-kube-api-access-mswh5\") pod \"maas-default-gateway-openshift-default-6cc458d887-wjvl5\" (UID: \"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.524626 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.524598    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:16.950449 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.950423    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"]
Oct 30 22:40:16.952702 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:40:16.952675    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c95b1a_67bf_4dd5_8b0b_1617a14bdfb9.slice/crio-1bd9c209281bb71df01a7862f843016249c070fd70f5d97864a732ed2c57e299 WatchSource:0}: Error finding container 1bd9c209281bb71df01a7862f843016249c070fd70f5d97864a732ed2c57e299: Status 404 returned error can't find the container with id 1bd9c209281bb71df01a7862f843016249c070fd70f5d97864a732ed2c57e299
Oct 30 22:40:16.954895 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.954864    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:16.954967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.954926    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:16.954967 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:16.954951    5967 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 22:40:17.915591 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:17.915558    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" event={"ID":"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9","Type":"ContainerStarted","Data":"6afb9974ef05bf6e6d1a7975d29dd4460fc32d992cfbd4a9cb39cb68f1245542"}
Oct 30 22:40:17.916000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:17.915613    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" event={"ID":"34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9","Type":"ContainerStarted","Data":"1bd9c209281bb71df01a7862f843016249c070fd70f5d97864a732ed2c57e299"}
Oct 30 22:40:18.136000 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:18.135946    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podStartSLOduration=2.135933106 podStartE2EDuration="2.135933106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:18.085884704 +0000 UTC m=+3306.200593059" watchObservedRunningTime="2026-10-30 22:40:18.135933106 +0000 UTC m=+3306.250641459"
Oct 30 22:40:18.525822 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:18.525775    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:18.527728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:18.527693    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:18.527887 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:18.527755    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:19.525830 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:19.525797    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:19.526238 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:19.525853    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:20.525743 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:20.525705    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:20.525945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:20.525760    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:21.524986 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:21.524946    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:21.525180 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:21.525004    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:22.525344 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:22.525312    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:22.525773 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:22.525403    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:23.525742 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:23.525698    5967 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-wjvl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:40:23.526158 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:23.525771    5967 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5" podUID="34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:40:25.182835 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:25.182802    5967 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:25.183356 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:25.183201    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:25.184021 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:25.184003    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-wjvl5"
Oct 30 22:40:35.656315 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:40:35.656275    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:40:53.052656 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:53.052566    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"]
Oct 30 22:40:53.101889 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:53.101860    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc5a4223-2czv9"]
Oct 30 22:40:54.017135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:40:54.017101    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a3fd503-ee9d-49e9-82da-b1b0f413670c" path="/var/lib/kubelet/pods/3a3fd503-ee9d-49e9-82da-b1b0f413670c/volumes"
Oct 30 22:41:05.597395 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:41:05.597334    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:41:13.609976 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:41:13.609944    5967 scope.go:122] "RemoveContainer" containerID="9248d29a72491edf2a6df3fc13132234299add83fee05d173da0c0242ad606f0"
Oct 30 22:41:13.618638 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:41:13.618616    5967 scope.go:122] "RemoveContainer" containerID="379efe5e4244708caf4e9baf39556a3a40aab213ad88be6e556342e956391ff5"
Oct 30 22:41:35.592568 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:41:35.592521    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:42:05.592109 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:42:05.592072    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:42:13.056713 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:42:13.056677    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"]
Oct 30 22:42:13.106159 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:42:13.106083    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d134d9eb-zv6bq"]
Oct 30 22:42:13.641397 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:42:13.641344    5967 scope.go:122] "RemoveContainer" containerID="ca2fead9c57f2c17e8b93d85c6bfea7346b768d346936c4104077289853b5c28"
Oct 30 22:42:14.017170 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:42:14.017126    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="274ae568-7b03-4864-9ae7-374002c7b69d" path="/var/lib/kubelet/pods/274ae568-7b03-4864-9ae7-374002c7b69d/volumes"
Oct 30 22:42:35.592845 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:42:35.592808    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:43:05.591786 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:43:05.591748    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:43:13.660543 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:43:13.660511    5967 scope.go:122] "RemoveContainer" containerID="13e66204e7106b38af9a46d94efd97e7fc92bb89d4d0e95bba507fc89d29af15"
Oct 30 22:43:35.593104 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:43:35.593064    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:44:05.592682 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:44:05.592642    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:44:35.593154 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:44:35.593115    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:45:05.591466 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:45:05.591426    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:45:15.426283 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:45:15.426227    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:45:15.455879 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:45:15.455850    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:45:35.591495 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:45:35.591458    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:46:05.591817 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:46:05.591778    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:46:35.593222 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:46:35.593184    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:47:05.591446 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:47:05.591410    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:47:35.591927 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:47:35.591889    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:48:05.591859 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:48:05.591821    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:48:35.592479 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:48:35.592444    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:49:05.592892 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:49:05.592853    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:49:35.592162 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:49:35.592123    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:50:05.592480 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:50:05.592349    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:50:15.465681 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:50:15.465649    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:50:15.491062 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:50:15.491033    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:50:35.592540 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:50:35.592500    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:51:05.592896 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:51:05.592857    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:51:35.591852 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:51:35.591815    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:52:05.592690 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:52:05.592651    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:52:35.592760 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:52:35.592720    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:53:05.592965 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:53:05.592922    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:53:35.592740 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:53:35.592700    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:54:05.592023 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:54:05.591981    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:54:35.592132 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:54:35.592094    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:55:05.592599 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:55:05.592493    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:55:15.499151 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:55:15.499124    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:55:15.523446 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:55:15.523419    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 22:55:35.597262 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:55:35.597218    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:56:02.164025 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.163983    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:02.167721 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.167703    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.208293 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.208245    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.208498 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.208344    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.208498 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.208399    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.208583 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.208521    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmfvr\" (UniqueName: \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.269668 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.269638    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:56:02.269917 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.269897    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:56:02.270068 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.270052    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp6qk\""
Oct 30 22:56:02.270150 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.270135    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:56:02.270589 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.270570    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 22:56:02.309864 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.309831    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.310027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.309872    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.310027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.309906    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmfvr\" (UniqueName: \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.310027 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.309982    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.310490 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.310466    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.312561 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.312542    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.312670 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.312582    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.312839 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.312822    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:02.371363 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.371328    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmfvr\" (UniqueName: \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\") pod \"maas-api-699557768d-bkpb8\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") " pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.481719 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.481686    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:02.864975 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.864952    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:02.867525 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:56:02.867498    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e73d9ae_3dc6_43e4_8ca9_940af499ca84.slice/crio-758f39a2834bc3bb920b2b48e152316beaecab1748ec0797a2dd6ee9fd3440f7 WatchSource:0}: Error finding container 758f39a2834bc3bb920b2b48e152316beaecab1748ec0797a2dd6ee9fd3440f7: Status 404 returned error can't find the container with id 758f39a2834bc3bb920b2b48e152316beaecab1748ec0797a2dd6ee9fd3440f7
Oct 30 22:56:02.868847 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:02.868830    5967 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:56:03.651301 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:03.651265    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" event={"ID":"9e73d9ae-3dc6-43e4-8ca9-940af499ca84","Type":"ContainerStarted","Data":"758f39a2834bc3bb920b2b48e152316beaecab1748ec0797a2dd6ee9fd3440f7"}
Oct 30 22:56:04.657945 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:04.657909    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" event={"ID":"9e73d9ae-3dc6-43e4-8ca9-940af499ca84","Type":"ContainerStarted","Data":"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"}
Oct 30 22:56:04.658409 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:04.658097    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:04.777135 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:04.777083    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" podStartSLOduration=1.830123302 podStartE2EDuration="2.777068193s" totalImagesPullingTime="946.944891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:04.776181809 +0000 UTC m=+4252.890890161" watchObservedRunningTime="2026-10-30 22:56:04.777068193 +0000 UTC m=+4252.891776550"
Oct 30 22:56:05.604825 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:56:05.604787    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:56:10.668990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.668964    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:10.678110 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.678084    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:10.687004 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.686961    5967 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" podUID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" containerName="maas-api" containerID="cri-o://d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5" gracePeriod=30
Oct 30 22:56:10.727956 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.727926    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"]
Oct 30 22:56:10.731511 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.731491    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.777212 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.777183    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"]
Oct 30 22:56:10.798786 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.798757    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-maas-api-tls\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.798963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.798809    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-metrics-certs\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.798963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.798837    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-openshift-service-ca\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.798963 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.798890    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9w7n\" (UniqueName: \"kubernetes.io/projected/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-kube-api-access-h9w7n\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.900196 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.900164    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-metrics-certs\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.900352 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.900212    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-openshift-service-ca\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.900352 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.900284    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9w7n\" (UniqueName: \"kubernetes.io/projected/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-kube-api-access-h9w7n\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.900491 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.900455    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-maas-api-tls\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.900990 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.900934    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-openshift-service-ca\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.902807 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.902780    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-metrics-certs\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.902978 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.902961    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-maas-api-tls\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:10.945616 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.945594    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:10.961720 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:10.961700    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9w7n\" (UniqueName: \"kubernetes.io/projected/37c894a8-eaba-48cc-9f60-ca72dbc4ffcf-kube-api-access-h9w7n\") pod \"maas-api-64576576bd-t5xxs\" (UID: \"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:11.001789 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.001754    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\") pod \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") "
Oct 30 22:56:11.001965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.001830    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\") pod \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") "
Oct 30 22:56:11.001965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.001908    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\" (UniqueName: \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\") pod \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") "
Oct 30 22:56:11.001965 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.001943    5967 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\") pod \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\" (UID: \"9e73d9ae-3dc6-43e4-8ca9-940af499ca84\") "
Oct 30 22:56:11.002147 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.002123    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca" pod "9e73d9ae-3dc6-43e4-8ca9-940af499ca84" (UID: "9e73d9ae-3dc6-43e4-8ca9-940af499ca84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:56:11.002250 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.002235    5967 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-openshift-service-ca\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:11.004178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.004152    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs" pod "9e73d9ae-3dc6-43e4-8ca9-940af499ca84" (UID: "9e73d9ae-3dc6-43e4-8ca9-940af499ca84"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:11.004178 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.004166    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls" pod "9e73d9ae-3dc6-43e4-8ca9-940af499ca84" (UID: "9e73d9ae-3dc6-43e4-8ca9-940af499ca84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:11.004310 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.004215    5967 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr" pod "9e73d9ae-3dc6-43e4-8ca9-940af499ca84" (UID: "9e73d9ae-3dc6-43e4-8ca9-940af499ca84"). InnerVolumeSpecName "kube-api-access-fmfvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:56:11.070728 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.070692    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:11.103459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.103159    5967 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-metrics-certs\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:11.103459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.103192    5967 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-maas-api-tls\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:11.103459 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.103208    5967 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmfvr\" (UniqueName: \"kubernetes.io/projected/9e73d9ae-3dc6-43e4-8ca9-940af499ca84-kube-api-access-fmfvr\") on node \"ip-10-0-130-176.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:11.445602 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.445579    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"]
Oct 30 22:56:11.448623 ip-10-0-130-176 kubenswrapper[5967]: W1030 22:56:11.448586    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c894a8_eaba_48cc_9f60_ca72dbc4ffcf.slice/crio-daa157e0e4cd27c7537a5b1b1f9bab3eb133b369616ee2b9339971a6d8624182 WatchSource:0}: Error finding container daa157e0e4cd27c7537a5b1b1f9bab3eb133b369616ee2b9339971a6d8624182: Status 404 returned error can't find the container with id daa157e0e4cd27c7537a5b1b1f9bab3eb133b369616ee2b9339971a6d8624182
Oct 30 22:56:11.692424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.692363    5967 generic.go:356] "Generic (PLEG): container finished" podID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" containerID="d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5" exitCode=0
Oct 30 22:56:11.692424 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.692413    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" event={"ID":"9e73d9ae-3dc6-43e4-8ca9-940af499ca84","Type":"ContainerDied","Data":"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"}
Oct 30 22:56:11.692955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.692438    5967 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8"
Oct 30 22:56:11.692955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.692470    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-bkpb8" event={"ID":"9e73d9ae-3dc6-43e4-8ca9-940af499ca84","Type":"ContainerDied","Data":"758f39a2834bc3bb920b2b48e152316beaecab1748ec0797a2dd6ee9fd3440f7"}
Oct 30 22:56:11.692955 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.692492    5967 scope.go:122] "RemoveContainer" containerID="d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"
Oct 30 22:56:11.693870 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.693850    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs" event={"ID":"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf","Type":"ContainerStarted","Data":"daa157e0e4cd27c7537a5b1b1f9bab3eb133b369616ee2b9339971a6d8624182"}
Oct 30 22:56:11.713643 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.713616    5967 scope.go:122] "RemoveContainer" containerID="d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"
Oct 30 22:56:11.713970 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:56:11.713951    5967 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5\": container with ID starting with d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5 not found: ID does not exist" containerID="d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"
Oct 30 22:56:11.714022 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.713981    5967 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5"} err="failed to get container status \"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5\": rpc error: code = NotFound desc = could not find container \"d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5\": container with ID starting with d81024612344ebc222b81f41a21011cf0af46d429d5935096a91b057e1b134b5 not found: ID does not exist"
Oct 30 22:56:11.860113 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.860079    5967 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:11.864294 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:11.864269    5967 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-bkpb8"]
Oct 30 22:56:12.016590 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:12.016561    5967 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" path="/var/lib/kubelet/pods/9e73d9ae-3dc6-43e4-8ca9-940af499ca84/volumes"
Oct 30 22:56:12.701005 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:12.700970    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs" event={"ID":"37c894a8-eaba-48cc-9f60-ca72dbc4ffcf","Type":"ContainerStarted","Data":"51226414bdc4ae5aac265a42d65e02d52beddbd605279b2cc866aaf6bbeb3ffe"}
Oct 30 22:56:12.701519 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:12.701088    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:12.820826 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:12.820766    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs" podStartSLOduration=2.075289208 podStartE2EDuration="2.820749452s" totalImagesPullingTime="745.460244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:12.818706527 +0000 UTC m=+4260.933414888" watchObservedRunningTime="2026-10-30 22:56:12.820749452 +0000 UTC m=+4260.935457804"
Oct 30 22:56:18.710909 ip-10-0-130-176 kubenswrapper[5967]: I1030 22:56:18.710880    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-64576576bd-t5xxs"
Oct 30 22:56:35.592316 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:56:35.592272    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:57:05.592297 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:57:05.592251    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:57:35.592875 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:57:35.592836    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:58:05.592055 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:58:05.592018    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:58:35.591598 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:58:35.591555    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:59:05.593112 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:59:05.593074    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 22:59:35.591694 ip-10-0-130-176 kubenswrapper[5967]: E1030 22:59:35.591656    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:00:05.592356 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:00:05.592318    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:00:15.529949 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:00:15.529923    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 23:00:15.555321 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:00:15.555300    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2nx9p_4bdd0c58-d8d2-44f8-b848-f329c17cff43/ovn-acl-logging/0.log"
Oct 30 23:00:35.591547 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:00:35.591510    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:00:59.905385 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:00:59.905343    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mp7g2_fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4/manager/0.log"
Oct 30 23:01:00.875546 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:00.875517    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f89ml_f95352f5-58ab-485b-bd52-a474348a525a/manager/0.log"
Oct 30 23:01:01.136145 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:01.136062    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-9f8ld_59b6b65e-95b4-4075-9719-f30f7adbdf44/proxy/0.log"
Oct 30 23:01:02.178129 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:02.178092    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64576576bd-t5xxs_37c894a8-eaba-48cc-9f60-ca72dbc4ffcf/maas-api/0.log"
Oct 30 23:01:05.577946 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:05.577917    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-46x5b_392751d1-2a25-4062-ae65-f9db9a9d8b6d/kuadrant-console-plugin/0.log"
Oct 30 23:01:05.591852 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:01:05.591820    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:01:08.025509 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:08.025473    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54874bdfcc-dzfxr_fc85c551-4494-4a9e-869b-eeb851123427/kube-auth-proxy/0.log"
Oct 30 23:01:09.295925 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:09.295894    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-dvp9t_04dec749-af2d-451c-a2bf-840b7f2816f3/istio-proxy/0.log"
Oct 30 23:01:09.562141 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:09.562071    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-f89xr_cde9df19-6dd8-470c-ac0e-e53397101e42/istio-proxy/0.log"
Oct 30 23:01:10.529595 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:10.529549    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-wjvl5_34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9/istio-proxy/0.log"
Oct 30 23:01:24.994423 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:24.994390    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mp7g2_fb9bdd14-9b60-4d1a-9fdb-ae5d38bd21f4/manager/0.log"
Oct 30 23:01:25.824117 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:25.824084    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f89ml_f95352f5-58ab-485b-bd52-a474348a525a/manager/0.log"
Oct 30 23:01:26.073571 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:26.073540    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-9f8ld_59b6b65e-95b4-4075-9719-f30f7adbdf44/proxy/0.log"
Oct 30 23:01:26.901409 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:26.901381    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64576576bd-t5xxs_37c894a8-eaba-48cc-9f60-ca72dbc4ffcf/maas-api/0.log"
Oct 30 23:01:29.940105 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:29.940074    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-46x5b_392751d1-2a25-4062-ae65-f9db9a9d8b6d/kuadrant-console-plugin/0.log"
Oct 30 23:01:32.134616 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:32.134587    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54874bdfcc-dzfxr_fc85c551-4494-4a9e-869b-eeb851123427/kube-auth-proxy/0.log"
Oct 30 23:01:33.417423 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:33.417365    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-dvp9t_04dec749-af2d-451c-a2bf-840b7f2816f3/istio-proxy/0.log"
Oct 30 23:01:33.682934 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:33.682848    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-f89xr_cde9df19-6dd8-470c-ac0e-e53397101e42/istio-proxy/0.log"
Oct 30 23:01:34.708050 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:01:34.708018    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-wjvl5_34c95b1a-67bf-4dd5-8b0b-1617a14bdfb9/istio-proxy/0.log"
Oct 30 23:01:35.592061 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:01:35.592029    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:02:05.592759 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:02:05.592678    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:02:35.590998 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:02:35.590962    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:02:57.847663 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:02:57.847623    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vmc55_cfa25fa1-62fb-44e6-a0de-1b885cea1c73/global-pull-secret-syncer/0.log"
Oct 30 23:03:00.773825 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:00.773794    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfpxl_30afacbf-8146-41aa-9298-672a74a30f81/konnectivity-agent/0.log"
Oct 30 23:03:01.147872 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:01.147795    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-176.us-west-1.compute.internal_7ff8f2bfa49239d9e2240c708e676d72/haproxy/0.log"
Oct 30 23:03:05.591781 ip-10-0-130-176 kubenswrapper[5967]: E1030 23:03:05.591739    5967 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-f4m64" containerName="extractor"
Oct 30 23:03:06.661948 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.661911    5967 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"]
Oct 30 23:03:06.662454 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.662397    5967 cpu_manager.go:414] "containerMap: removing container" podUID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" containerName="maas-api"
Oct 30 23:03:06.662454 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.662415    5967 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" containerName="maas-api"
Oct 30 23:03:06.662534 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.662513    5967 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e73d9ae-3dc6-43e4-8ca9-940af499ca84" containerName="maas-api"
Oct 30 23:03:06.665681 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.665662    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.718039 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.718001    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz784\"/\"openshift-service-ca.crt\""
Oct 30 23:03:06.755826 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.755784    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-podres\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.756025 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.755928    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws4m4\" (UniqueName: \"kubernetes.io/projected/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-kube-api-access-ws4m4\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.756025 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.755963    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-proc\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.756025 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.755996    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-sys\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.756156 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.756037    5967 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-lib-modules\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.767587 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.767546    5967 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wz784\"/\"default-dockercfg-hz9zx\""
Oct 30 23:03:06.767772 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.767633    5967 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz784\"/\"kube-root-ca.crt\""
Oct 30 23:03:06.769074 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.769047    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"]
Oct 30 23:03:06.857379 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857345    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-lib-modules\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857573 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857457    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-podres\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857573 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857510    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws4m4\" (UniqueName: \"kubernetes.io/projected/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-kube-api-access-ws4m4\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857573 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857513    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-lib-modules\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857573 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857573    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-proc\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857743 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857527    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-proc\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857743 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857588    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-podres\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857743 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857624    5967 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-sys\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.857743 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.857655    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-sys\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.918812 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.918737    5967 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws4m4\" (UniqueName: \"kubernetes.io/projected/2329d26e-2b8d-4a80-8acf-483f43f1c4e1-kube-api-access-ws4m4\") pod \"perf-node-gather-daemonset-h49ws\" (UID: \"2329d26e-2b8d-4a80-8acf-483f43f1c4e1\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:06.961843 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.961812    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-46x5b_392751d1-2a25-4062-ae65-f9db9a9d8b6d/kuadrant-console-plugin/0.log"
Oct 30 23:03:06.978195 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:06.978140    5967 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:07.357483 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:07.357449    5967 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"]
Oct 30 23:03:07.360721 ip-10-0-130-176 kubenswrapper[5967]: W1030 23:03:07.360687    5967 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2329d26e_2b8d_4a80_8acf_483f43f1c4e1.slice/crio-a5698b86e2ce8fff3f3fd2bf595a65a53358c61bad9b3b14ea1baec5485c305b WatchSource:0}: Error finding container a5698b86e2ce8fff3f3fd2bf595a65a53358c61bad9b3b14ea1baec5485c305b: Status 404 returned error can't find the container with id a5698b86e2ce8fff3f3fd2bf595a65a53358c61bad9b3b14ea1baec5485c305b
Oct 30 23:03:07.689428 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:07.689318    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws" event={"ID":"2329d26e-2b8d-4a80-8acf-483f43f1c4e1","Type":"ContainerStarted","Data":"378a07531e3592f0b464eed83b9bc5c0255abbf667318cb7c10c6e41dfd1ffab"}
Oct 30 23:03:07.689428 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:07.689404    5967 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws" event={"ID":"2329d26e-2b8d-4a80-8acf-483f43f1c4e1","Type":"ContainerStarted","Data":"a5698b86e2ce8fff3f3fd2bf595a65a53358c61bad9b3b14ea1baec5485c305b"}
Oct 30 23:03:07.689855 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:07.689541    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:07.806773 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:07.806722    5967 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws" podStartSLOduration=1.8067069839999998 podStartE2EDuration="1.806706984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:03:07.804422653 +0000 UTC m=+4675.919131004" watchObservedRunningTime="2026-10-30 23:03:07.806706984 +0000 UTC m=+4675.921415331"
Oct 30 23:03:10.934073 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:10.934044    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/alertmanager/0.log"
Oct 30 23:03:11.351908 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:11.351876    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/config-reloader/0.log"
Oct 30 23:03:11.780257 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:11.780228    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/kube-rbac-proxy-web/0.log"
Oct 30 23:03:12.198797 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:12.198726    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/kube-rbac-proxy/0.log"
Oct 30 23:03:12.626006 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:12.625971    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/kube-rbac-proxy-metric/0.log"
Oct 30 23:03:13.045655 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:13.045619    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/prom-label-proxy/0.log"
Oct 30 23:03:13.463914 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:13.463890    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_03a6147e-6b1e-4715-a9c4-28319b6e4b4c/init-config-reloader/0.log"
Oct 30 23:03:13.704441 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:13.704416    5967 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-h49ws"
Oct 30 23:03:14.420219 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:14.420189    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-2qz7n_497b8e7d-4ec6-4aa0-bcb5-588889dff64b/kube-state-metrics/0.log"
Oct 30 23:03:14.833507 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:14.833472    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-2qz7n_497b8e7d-4ec6-4aa0-bcb5-588889dff64b/kube-rbac-proxy-main/0.log"
Oct 30 23:03:15.252276 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:15.252245    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-2qz7n_497b8e7d-4ec6-4aa0-bcb5-588889dff64b/kube-rbac-proxy-self/0.log"
Oct 30 23:03:15.676125 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:15.676047    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9cfb6c9d5-btlkb_64c55ef5-2a2d-4ea9-9c45-dada2d2ad3ed/metrics-server/0.log"
Oct 30 23:03:16.097920 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:16.097890    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-pxl8b_8aa5ed76-7b28-4719-a111-512d990b5e70/monitoring-plugin/0.log"
Oct 30 23:03:17.780931 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:17.780902    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9fg6_63792577-37e5-4fd1-9398-a3901b22b391/node-exporter/0.log"
Oct 30 23:03:18.222849 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:18.222817    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9fg6_63792577-37e5-4fd1-9398-a3901b22b391/kube-rbac-proxy/0.log"
Oct 30 23:03:18.640609 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:18.640538    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9fg6_63792577-37e5-4fd1-9398-a3901b22b391/init-textfile/0.log"
Oct 30 23:03:20.339572 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:20.339539    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-h95d5_07c28eb9-feb7-44f1-ae79-32a241449056/kube-rbac-proxy-main/0.log"
Oct 30 23:03:20.758305 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:20.758254    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-h95d5_07c28eb9-feb7-44f1-ae79-32a241449056/kube-rbac-proxy-self/0.log"
Oct 30 23:03:21.177755 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:21.177633    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-h95d5_07c28eb9-feb7-44f1-ae79-32a241449056/openshift-state-metrics/0.log"
Oct 30 23:03:21.608460 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:21.608436    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/prometheus/0.log"
Oct 30 23:03:22.043683 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:22.043660    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/config-reloader/0.log"
Oct 30 23:03:22.463392 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:22.463295    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/thanos-sidecar/0.log"
Oct 30 23:03:22.884584 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:22.884510    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/kube-rbac-proxy-web/0.log"
Oct 30 23:03:23.303745 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:23.303711    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/kube-rbac-proxy/0.log"
Oct 30 23:03:23.998357 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:23.998312    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/kube-rbac-proxy-thanos/0.log"
Oct 30 23:03:24.421838 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:24.421759    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3a2f429-c5d6-4242-b470-ff85899d6027/init-config-reloader/0.log"
Oct 30 23:03:24.850822 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:24.850794    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-k8m2t_904e4f55-1d16-4919-b398-15506d1c2e7c/prometheus-operator/0.log"
Oct 30 23:03:25.266723 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:25.266680    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-k8m2t_904e4f55-1d16-4919-b398-15506d1c2e7c/kube-rbac-proxy/0.log"
Oct 30 23:03:26.115263 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:26.115213    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679f8f864b-9b6s6_648997b6-6ac2-41db-9d70-ced80bde4874/telemeter-client/0.log"
Oct 30 23:03:26.531921 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:26.531894    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679f8f864b-9b6s6_648997b6-6ac2-41db-9d70-ced80bde4874/reload/0.log"
Oct 30 23:03:26.951022 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:26.950945    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679f8f864b-9b6s6_648997b6-6ac2-41db-9d70-ced80bde4874/kube-rbac-proxy/0.log"
Oct 30 23:03:27.376030 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:27.375994    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/thanos-query/0.log"
Oct 30 23:03:27.793613 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:27.793590    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/kube-rbac-proxy-web/0.log"
Oct 30 23:03:28.212412 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:28.212317    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/kube-rbac-proxy/0.log"
Oct 30 23:03:28.631767 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:28.631738    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/prom-label-proxy/0.log"
Oct 30 23:03:29.050945 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:29.050912    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/kube-rbac-proxy-rules/0.log"
Oct 30 23:03:29.472650 ip-10-0-130-176 kubenswrapper[5967]: I1030 23:03:29.472621    5967 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d9c499cc7-5mr27_f91247e1-6c15-4eb3-909c-4145e59ec71a/kube-rbac-proxy-metrics/0.log"